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FOREWORD 

a.  This  technical  report,  BDM/A-127Q-TR,  is  submitted  by  the  BDM 
Corporation,  1301  Randolph  Road  SE,  Albuquerque,  New  Mexico  87106  to 
the  Air  Fore  Operational  Test  and  Evaluation  Center,  Kirtland  Air 
Force  Base,  Albuquerque,  New  Mexico  87117-7001.  This  submission  is 
in  compliance  with  the  requirements  of  paragraph  7.1  of  Subtask 
Statement  412/01,  titled  "Software  Supportabi lity  Risk  Assessment: 
Pilot  Application." 

b.  This  report  is  the  result  of  effort  by  Mr.  Walter  Huebner,  Jr. 
(Task  Leader),  Or.  David  Peercy  (Technical  Leader),  Mr.  M.  Donan 
Estill,  Jr.  and  Ms.  Kelley  L.  Shaw  of  The  BDM  Corporation.  The 
primary  Subtask  Statement  Project  Officer  is  Capt.  Eric  H.  Tomlin 
(AF0TEC/LG5T) ;  the  alternate  Subtask  Statement  Project  Officer  is 
Maj.  Gary  R.  Horlbeck  (AF0TEC/LG5T) . 

Reviewed  and  approved  by: 


Walter  F.  Huebner 
Program  Manager 
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SECTION  I 

INTRODUCTION 

1.1  PURPOSE  OF  USER'S  HANDBOOK. 

The  purpose  of  this  user's  handbook  is  to: 

(1)  Oocument  procedures  necessary  to  apply  automated  and 

manual  analysis  tools  to  accomplish  a  high  level  risk 
assessment  of  a  software  system's  supportabi 1 ity  in 
accordance  with  the  Risk  Assessment  Methodology  for  Soft¬ 
ware  Supportabi 1 ity  (RAMSS)  in  references  1.4.2  -  1.4.7; 

(2)  Document  procedures  necessary  to  access,  update,  and 

modify  the  historical  data  base  of  evaluation  and  main¬ 
tenance  release  data  required  by  the  RAMSS. 

1.2  OBJECTIVE  OF  RAMSS. 

The  objective  of  the  RAMSS  is  to  provide  information  from 

which  the  risk  to  the  Air  Force  of  supporting  a  software  system  can 
be  derived.  This  information  is  organized  so  that  specific  high 
level  risk  drivers  can  be  identified  for  possible  trade-off  analyses. 
This  information  is  derived  from  evaluation  data  which  AFOTEC  or 

AFOTEC-designated  personnel  collect  as  part  of  the  current  software 
supportabi 1 ity  evaluation  process. 

1.3  GENERAL  ORGANIZATION  OF  THE  HAND800K . 

a.  This  handbook  is  organized  around  two  primary  functions: 

(1)  Assessing  a  software  system's  supportabi I i ty  risk; 

(2)  Updating  the  historical  data  base(s). 
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b.  An  overview  of  the  procedures  and  the  automated  support 
system  tools  which  assist  you  in  accomplishing  these  functions  is 
presented  in  section  2.  The  functional  features,  hardware  and  soft¬ 
ware  support  environment,  data  bases  and  other  files,  performance 
considerations,  and  the  primary  user  responsibilities  and  procedures 
are  briefly  discussed. 

c.  The  detailed  procedures  for  assessing  software  supportab i 1 i ty 
risk  are  presented  in  section  3.  The  procedural  steps  include 
building  the  user/supporter  (using  command/supporting  command) 
baseline  estimate,  entering  evaluation  scores,  performing  necessary 
analysis,  and  generating  the  risk  assessment  reports.  In  addition, 
some  analysis  considerations  with  which  you  should  be  concerned  are 
discussed. 

d.  The  detailed  procedures  for  updating  evaluation  analysis  data 
and  maintenance  release  data  are  presented  in  section  4.  Basic 
entry/update  of  the  data  base  values  from  menu  selection  is  described 
for  all  data  bases.  The  primary  procedures  to  update  BMDP  analysis 
data  involve  generating  new  evaluation  data,  risk  regression  coeffi¬ 
cients,  and  new  maintenance  release  data  profiles.  In  addition,  some 
analysis  considerations  with  which  you  should  be  concerned  are 
discussed. 

e.  The  RAMSS  reports  provide  you  the  results  of  the  software 
supportability  risk  assessment.  There  are  dBASE  III  and  BMDP  RAMSS 
printed  reports.  In  addition,  you  can  develop  custom  dBASE  III  and 
BMDP  reports  if  necessary.  The  procedures  for  generating  the  RAMSS 
reports  are  presented  in  section  5. 

f.  The  procedures  necessary  to  install  and  operate  the  RAMSS 
automated  support  software  on  your  hardware,  archive  application  data 
bases  and  software  to  floppy  disks  for  backup  or  version  storage,  and 
recover  archived  application  data  bases  and  software  are  described  in 
section  6.  You  should  be  thoroughly  familiar  with  this  section. 
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g.  Several  appendices  provide  additional  information.  A  complete 
set  of  example  display  screens  is  presented  in  appendix  A.  A  set  of 
example  dBASE  III  RAMSS  reports  is  presented  in  appendix  B.  A  set  of 
example  BMOP  RAMSS  reports  is  presented  in  appendix  C.  A  hierarchy 
diagram  of  the  dBASE  III  programs  and  BMDP  programs  which  constitute 
the  RAMSS  automated  support  software  is  presented  in  appendix  D.  A 
detailed  description  of  the  data  base  and  memory  file  structures  is 
presented  in  appendix  £.  A  glossary  is  presented  in  appendix  F. 
These  appendices  along  with  the  documentation  in  the  delivered  source 
code  constitute  the  available  software  specifications. 

1.4  REFERENCES. 

The  following  documents  are  referenced  by  this  handbook: 

(1)  1.4.1  "Software  Supportabi 1 ity  Risk  Assessment:  Pilot 

Application,"  Subtask  Statement  412  for  AFOTEC  Contract 
F29601-85-C-0058,  AFOTEC,  Kirtland  AFB,  NM,  October  1985. 

(2)  1.4.2  Hoessel,  W.,  W.  Huebner,  D.  Peercy,  G.  Richardson, 

"Software  Supportabi 1 ity  Risk  Assessment  in  OT&E:  Liter¬ 
ature  Review,  Current  Research  Review,  and  Data  Base 
Assemblage,"  BDM/A-84-0322-TR  (Final),  September  1984. 

(3)  1.4.3  Huebner,  W.,  0.  Peercy,  G.  Richardson,  "Software 

Supportabi 1 ity  Risk  Assessment  in  OT&E:  An  Evaluation  of 
Risk  Methodologies,"  BDM/A-84-0496-TR  (Final),  August 
1984. 

(4)  1.4.4  Huebner,  W.,  0.  Peercy,  G.  Richardson,  "Software 

Supportabi 1 ity  Risk  Assessment  in  OT&E:  Measures  for  a 
Risk  Assessment  Model,"  BDM/A-84-0565-TR  (Final), 
September  1984. 
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(5)  1.4.5  Peercy,  0.,  W.  Huebner,  M.  Estill,  J.  Wu,  "Soft¬ 
ware  Supportabi 1 ity  Risk  Assessment  in  QT&E:  Historical 
Baselines  for  Risk  Profiles,"  BDM/A-85-051G-TR  (Vols  I 
and  II),  October  1985. 

(6)  1.4.6  Peercy,  0.,  W.  Huebner,  "Risk  Assessment  Method¬ 
ology  for  Software  Supportability  (RAMSS):  Guidelines 

for  Adapting  Software  Supportability  Evaluations", 
BDM/ABQ-86-0090-TR,  April  1986. 

(7)  1.4.7  Peercy,  0.,  W.  Huebner,  M.  Estill,  K.  Shaw,  "Risk 

Assessment  Methodology  for  Software  Supportability 
(RAMSS):  Pilot  Evaluation  Results  and  Methodology 

Refinement,"  8DM/ABQ-86-0360-TR,  April  1986. 

(8)  1.4.8  AFOTECP  800-2  Volumes  I  through  5,  Software  OT&E 
Guide! ines. 

(9)  1.4.9  dBASE  III  User  Manual,  Ashton  Tate,  Culver  City, 

CA,  1984. 

(10)  1.4.10  8MDPC:  User's  Guide  to  BMDP  on  the  IBM  PC,  BMDP 

Statistical  Software,  Inc.,  Los  Angeles,  CA,  (no  date). 

1.5  TERMS  AND  ABBREVIATIONS. 

AF  Air  Force 

AFB  Air  Force  Base 

AF0TEC  Air  Force  Operational  Test  and  Evaluation  Center 

AISF  Avionics  Integration  Support  Facility 

Al.C  Air  Logistics  Center 

APT  Available  Person  Time 

ASIT  Adaptable  Surface  Interface  Terminal 

ASSET  AF0TEC  Software  Support  Evaluation  Tool 
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ATD  Aircrew  Training  Device 

ATE  Automatic  Test  Equipment 

BMDP  BMDP  Statistical  Software  (NOTE:  BMDP  is  a  name,  not  an 

acronym. ) 

C-E  Communications-Electronics 

CDR  Critical  Design  Review 

Cl  Configuration  Item 

CM  Configuration  Management 

CMP  Conf iguration  Management  Plan 

CMS  Conf iguration  Management  System 

CRISP  Computer  Resources  Integrated  Support  Plan 

CSCI  Computer  Software  Configuration  Item 

DPS  Data  Processing  System 

DT&E  Development  Test  and  Evaluation 

OOD  Department  of  Defense 

ECS  Embedded  Computer  System 

EW  Electronic  Warfare 

HQ/TAC  Headquarters  Tactical  Air  Command 

IOC  Initial  Operational  Capability 

I V&V  Independent  Verification  and  Validation 

JTIDS  Joint  Tactical  Information  Distribution  System 

OFP  Operational  Flight  Program 

0/S  CMP  Operational/Support  Configuration  Management  Procedures 

OSTF  Off-Site  Test  Facility 

OT&E  Operational  Test  and  Evaluation 

PDR  Percentage  of  the  Persons  Dedicated  to  the  Block  Release 

PDS  Percentage  of  the  Persons  Dedicated  to  the  Software 

System 

PMD  Program  Management  Directive 

PMP  Program  Management  Plan 

PMPC  Person-Months  per  Change 

RA  Risk  Assessment 

RAMSS  Risk  Assessment  Methodology  for  Software  Supportabi 1 i ty 

S/W  Software 


JTIDS 

OFP 

0/S  CMP 
OSTF 
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SIM 

Simulation 

SM-ALC 

Sacramento  ALC 

SMCP 

System  Maintenance  Computer  Program 

SP/USER 

Signal  Processor  User  Simulator 

SS 

Software  Supportabi 1 ity 

SS 

Software  Support 

SSF 

Software  Support  Facility 

SUP 

Support  Utility 

SYS 

System 

UTIL 

Utility 

WR-ALC 

Warner  Robins  ALC 

II.  Overview  of  System 
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SECTION  II 

OVERVIEW  OF  RAMSS  AUTOMATED  SUPPORT  SYSTEM 

2.1  INTRODUCTION. 

a.  The  RAMSS  automated  support  system  is  a  menu-driven  tool 
designed  to  execute  on  IBM-PC/AT  or  compatible  hardware  with  one 
floppy  disk,  one  hard  disk,  and  one  dot  matrix  printer.  All  appli¬ 
cable  support  software  is  written  in  DOS,  dBASE  III,  or  BMOP  statis¬ 
tical  software  control  language,  and  executes  under  the  PC-DOS  or 
MS-DOS  operating  system. 

b.  The  interfaces  are  through  console  menu  selection  and  data 
entry,  and  output  reports  generated  on  the  printer.  The  system  iu 
very  simple.  The  system  does  not  provide  a  wide  variety  of  "what-if" 
analysis  or  custom  reports.  Its  focus  is  upon  providing  a  basic 
capability  to  enter  evaluation  data,  receive  an  assessment  of  the 
associated  software's  supportabi 1 ity  risk  through  printed  reports, 
and  update  the  necessary  historical  data  bases. 

c.  A  general  introduction  to  the  RAMSS  automated  support  system 
and  its  use  in  supporting  the  required  procedures  to  accomplish  risk 
assessment  and  historical  data  update  is  presented  in  the  following 
subsections.  If  you  are  interested  in  installing  or  initiating 
operation  of  the  system,  see  section  6. 

2.2  RESPONSIBILITIES  AND  INTERFACES. 

a.  You  have  the  responsibility  to  clearly  understand  the  con¬ 
straints,  limitations,  procedures  and  general  operational  require¬ 
ments  presented  in  this  handbook.  The  users'  guides  for  dBASE  III 
(see  reference  1.4.9)  and  BMDP  (see  reference  1.4.10)  must  be  under¬ 
stood  to  the  extent  the  information  in  those  guides  is  used  by  this 
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system.  You  must  understand  the  hardware  manuals  and  procedures 
dictated  by  the  specific  hardware  system  upon  which  this  software  is 
installed.  Reasonable  cautions,  warnings,  and  possible  user  or 
system  errors  are  described  in  this  handbook,  but  undoubtedly  there 
will  be  unanticipated  situations. 

b.  You  have  the  responsibility  to  obtain  credible  evaluation  data 
for  entry  to  the  risk  assessment  procedure  and  to  correctly  enter 
these  data  in  the  form  required  by  this  system.  The  validity  of  the 
software  supportabi 1 ity  risk  assessment  is  based  upon  valid  evalua¬ 
tion  and  maintenance  release  data. 

c.  The  only  interfaces  involve  selection  of  options  from  a  menu 
screen,  entry/update  of  evaluation  data  on  a  screen  displaying  the 
appropriate  variables,  entry/update  of  historical  maintenance  release 
data,  and  review/analysis  of  the  RAMSS  printed  reports.  You  must 
execute  BMDP  programs  by  invoking  8MDP  command  files.  In  the  case  of 
the  risk  regression  equation,  you  must  manually  enter  the  regression 
coefficients  from  the  printed  BMDP  report  on  a  dBASE  III  menu  screen. 
It  may  also  be  necessary  to  manually  connect  dots  on  certain  printed 
report  plots  in  order  to  achieve  a  more  satisfactory  graphic.  Plots 
and  charts  are  crudely  generated  using  dBASE  III  programs.  A  more 
satisfactory  output  could  easily  be  produced  using  a  graphics 
package.  No  graphics  package  was  identified  for  use,  so  dBASE  III 
was  determined  to  be  adequate  at  this  time  for  report  generation. 

2.3  CONFIGURATION  OF  HARDWARE  AND  SOFTWARE  ENVIRONMENT. 

a.  The  hardware  and  software  environment  is  illustrated  in 


DOT  MATRIX  PRINTER  — 

figure  2-1.  RAMSS  Automated  Support  System  Hardware  and  Software  Environment 
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b.  The  hardware  items  consist  of: 

(1)  IBM  PC/AT  CPU  or  compatible  with  640  kbytes  of  memory  and 
floating  point  coprocessor 

(2)  One  floppy  disk  storage  unit  (minimum  of  356  kbytes) 

(3)  One  hard  disk  storage  unit  (minimum  of  5  Mbytes) 

(4)  One  monochrome  display  console  (minimum  of  80  characters 
by  24  lines) 

(5)  One  dot  matrix  printer  (minimum  of  132  characters). 

c.  The  software  items  consist  of: 

(1)  PC-DOS  or  MS-OOS  operating  system  (version  3.10  or  later) 

(2)  dBASE  III  data  base  management  system  (version  1.1  or 
later) 

(3)  BMDP/PC  statistical  software  package  (1985  version) 

(4)  Application  specific  software  package. 

The  application  software  consists  of  dBASE  III  programs,  data  bases, 
report  files,  memory  files,  index  files,  and  BMDP  command  files. 

2.4  DATA  8ASES  AND  FILES. 

a.  There  are  several  dBASE  III  data  bases  and  related  files,  and 
seven  BMDP  command  files  in  the  application  software  as  illustrated  in 
figure  2-2. 
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RASYSI.OBF 


USER/ 

SUPPORTER  4 

BASELINE 

FSTIMATF 

1—  RAUSBE.OBF 

VARIABLE 

DESCRIPTION 

RASYSI.OBF 

RAEVAL.  DBF 

- 

EVALUATION 

DATA 

VARIABLE  4 
DESCRIPTIONS 

RAUS8C _ 0.08F 

RAEVAL_O.DBF 

- 

VARIABLE 

DESCRIPTIONS 

MAINTENANCE  U—  RARLSE.DBF 
RELEASE  DATA  I 


RARLSE  O.DBF 


RAEVAL1 1.FRM 

PART  I  OF 
EVALUATION 
REPORT  D1 


RAEVAL12.FRM 

PART  2  OF 
EVALUATION 
REPORT  01 

RAEVAL13.FRM 

PART  3  OF 
EVALUATION 
REPORT  01 

RAEVAL14.FRM 

PART 4  OF 
EVALUATION 
REPORT  01 

RARLSE  1.FRM 

PART  1  OF 
EVALUATION 
REPORT  D2 

RARLSE2.FRM 

PART  2  OF 

EVALUATION  REPORT 
_ 02 _ 

RARLSE3.FRM 

PART  3  OF 
EVALUATION 
REPORT  02 


dBASE  III 
REPORT 
'  FORMAT 
FILES 


RAAFTH.MEM 

AFOTEC  SPEOFIC 
PARAMETERS 


RAMFCO.MEM 

EVALUATED  RISK 
REGRESSION 
COEFFICIENTS 


RAPMCO.MEM 

ESTIMATED  PMPC 
REGRESSION 
COEFFICIENTS 


RASVSIIO.NOX 

BUILT  ON 
FIELO 
SWSYSIO 


RASYSISS.NOX 

BUILT  ON 
FIELDS  SYSTEM  ♦ 
SWSYSIO 

RAUSSEID.NOX 

BUILT  ON 
FIELO 
SWSYSIO 

RAEVALIO.NOX 

BUILT  ON 
FIELO 
SWSYSIO 

RASLCPIO.NOX 

BUILT  ON 
FIELO 
SWSYSIO 

RARLSEIO.NOX 

BUILT  ON 
FIELO 

_ SWSYSID 

RARLSESR.NOX 

BUILT  ON 
FIELDS 

SWSYSIO  ♦  RLSIO 


dBASE  III 
MEMORY 
FILES 


dBASE  III 
INDEX 
FILES 


RASLCP.  DBF 


RASLCP  O.DBF 


SOFTWARE  LIFE 
CYCLE  PROCESS 
DATA 

VARIABLE 

DESCRIPTIONS 


EVAL1D.CTL 


COMPUTES 

DESCRIPTIVE 

STATISTICS 


EVALSO.CTL 

PRODUCES 

HISTOGRAMS 

EVAL1R.Cn 

COMPUTES 
EVALUATED  RISK 
REGRESSION  EQ 

MAINT10.CTL 

COMPUTES 

DESCRIPTIVE 

STATISTICS 

MAINT5D.CTL 

PRODUCES 

MAINTENANCE 

PROFILES 

MAINT70.cn 

PLOTS 

MAINTENANCE 

PROFILES 

MAINT1R.CTL 

COMPUTES 
ESTIMATED  PMPC 
REGRESSION  EQ. 


BMOP 

COMM. 

FILES 


Figure  2-2.  RAMSS  Automated  Support  System  Data 
Bases  and  Files 
1 1- 5 
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b.  The  dBASE  III  data  bases  include: 

(1)  RASYSI.OBF  -  System  Information 

(2)  RASYSIJ3.DBF  -  System  Information  Variable  Descriptions 

(3)  RAUSBE.DBF  -  User/Supporter  Baseline  Estimate 

(4)  RAUS8E_D.DBF  -  User/Supporter  Baseline  Estimate  Variable 

Descriptions. 

(5)  RAEVAL.DBF  -  Evaluation  Data 

(6)  RAEVAL_D.D8F  -  Evaluation  Data  Variable  Descriptions 

(7)  RASLCP.D8F  -  Evaluation  Data  for  Software  Life  Cycle 

Process  (SLCP) 

(8)  RASLCP  Jl.DBF  -  Evaluation  Data  (SLCP)  Variable  Descrip¬ 

tions 

(9)  RARLSE.D8F  -  Maintenance  Release  Data 

(10)  RARLSEJ3.DBF  -  Maintenance  Release  Data  Variable  Descrip¬ 
tions 

c.  The  dBASE  III  memory  files  include: 

(1)  RAAFTH.MEM  -  AFOTEC  Specific  Parameters  (e.g.,  Thresh¬ 

old/Goal  ) 

(2)  RAMFCO.MEM  -  Major  Factor  Regression  Coefficients 

(3)  RAPMCO.MEM  -  Estimated  Person  Months  Per  Change  Regres¬ 

sion  Coefficients 
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d.  The  dBASE  III  index  files  include: 


(1) 

RASYSIID.NDX 

-  Built  from 

SWSYSID 

RASYSI.DBF 

on 

the 

field 

(2) 

RASYSISS. NDX 

-  Built  from  RASYSI.DBF  on  the 

of  fields  SYSTEM  and  SWSYSTEM 

combination 

(3) 

RAUSBEID.NDX 

-  Built  from 

SWSYSID 

RAUSBE.DBF 

on 

the 

field 

(4) 

RAEVALID.NDX 

-  Built  from 

SWSYSID 

RAEVAL. DBF 

on 

the 

field 

(5) 

RASLCPIO.NDX 

-  Built  from 

SWSYSID 

RASLCP. DBF 

on 

the 

field 

(6) 

RARLSEID. NDX 

-  Built  from 

SWSYSID 

RARLSE. DBF 

on 

the 

field 

(7) 

RARLSESR. NDX 

-  Built  from 

RARLSE.D8F  on 

the 

combination 

of  fields  SWSYSID  and  RLSID. 

*Note:  The  numeric  field  SWSYSID  is  converted  to  a 

character  string  while  the  index  file  is  being  built. 
This  is  necessary  when  building  index  files  on  a  combina¬ 
tion  of  fields. 

e.  The  8MDP  command  files  include: 

(1)  EVAL1D.CTI  -  Reads  ASCII  evaluation  data  file,  creates 

SAVE  file  EVAL.SAV,  computes  simple  des¬ 
criptive  statistics 


THE  BOM  CORPORATION 


BDM/A-85-1270-TR 


(2)  EVAL5D.CTL  -  Produces  histograms  and  cumulative  fre¬ 

quency  plots  of  supportabil ity  factors  and 
ri  sk 

(3)  EVALlR.CTt  -  Computes  coefficients  for  evaluated  risk 

regression  equation,  plots  transformed 
risk  ( L( RISK ) )  values  against  each  of  the 
supportability  factors 

(4)  MAINT1D.CTL  -  Reads  ASCII  maintenance  data  file,  creates 

SAVE  file  MAINT.SAV,  computes  simple  des¬ 
criptive  statistics 

(5)  MAINT5D.CTL  -  Produces  maintenance  profiles  (histograms 

of  person-months  per  change)  for: 

-  All  releases  combined 

-  All  software  types  combined 

-  All  software  types  separately 

(6)  MAINT7D.CTL  -  Plots  maintenance  profiles  for  all  soft¬ 

ware  types  side-by-side  for  comparison 

(7)  MAINT1R.CTI  -  Computes  coefficients  for  estimated 

person-months  per  change  regression  equa¬ 
tion. 

A  more  complete  description  and  listing  of  each  data  base  and  file 
variable  is  presented  in  appendix  E. 
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2.5  PERFORMANCE. 


Typical  performance  and  size  attributes  of  the  application 
software  are  given  in  the  next  few  paragraphs.  The  term  "pp"  means 
printed  page. 


2.5.1  Inputs. 


For  each  system  evaluated: 

System  Identification  Data-5  variables 
User/Supporter  Baseline  Estimate  -  38  variables 
Evaluation  Scores  (Software  Product)  -  12  variables 
Evaluation  Scores  (Software  Support  Resources) 
12  variables 

Evaluation  Scores  (Software  Life  Cycle  Process) 
10  variables 

(potential  of  400  lower  level  variable  scores) 


(2)  For  each  system  with  maintenance  data: 
System  Identification  Data  -  5  variables 
Maintenance  Release  Data  -  26  variables 


2.5.2  Outputs. 


Risk  Assessment  Reports: 

User/Supporter  Baseline  Estimate  -  1  pp 
Evaluation  Scores  (one  software  system)  -  1  pp 
Major  Factor  Percentile  Chart  -  2  pps 
Major  Factor  Risk  Impact  Chart  -  1  pp 
Maintenance  Profile  CDF  Plot  -  3  pps 
Software  Supportabi 1 ity  Risk  Assessment  Summary 


-  1  pp  or  2  pps 


(2)  Evaluation  Data  Base  Update  Reports: 

Table  of  Evaluation  Data  (all  systems)  -  49  systems/pp 
BMOP  Risk  Regression  Equation  Reports  -  20/pps 


(3)  Maintenance  Release  Data  Base  Update  Reports: 
Table  of  Maintenance  Release  Data  (all  systems) 
48  releases/pp 

8MDP  Maintenance  Profile  Reports  -  60/pps 


2.5.3  Response  Time. 


a.  Typical  response  time  for  menu  screen  interactions  is  imme¬ 
diate,  Entry  of  evaluation  or  maintenance  release  data  depends 
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somewhat  upon  your  skills,  but  typically  should  take  no  more  than  10 
to  30  minutes  per  evaluation  set  or  maintenance  release.  The  time  to 
perform  necessary  computations  and  print  the  dBASE  III  evaluation 
analysis  reports  (A1-A6)  is  approximately  10  minutes.  It  takes 
approximately  10  minutes  to  print  the  table  report  of  evaluation 
data.  The  time  to  print  the  table  report  of  maintenance  release  data 
is  approximately  25  minutes.  The  time  to  execute  the  BMOP  program  to 
update  the  evaluated  risk  regression  equation  and  print  out  the 
subsequent  reports  is  approximately  30  minutes.  It  takes  approxi¬ 
mately  1  hour  to  execute  the  BMOP  programs  to  update  the  estimated 
person-months  per  change  regression  equation  and  print  the  subsequent 
reports. 

b.  Specific  equipment  configurations  including  CPU  and  printer 
may  affect  the  above  approximate  response  time  estimates,  but  not 
signif icantly. 

2.5.4  Limitations . 


a.  The  only  limitations  which  might  be  a  factor  in  the  future 
would  be  the  disk  space  necessary  for  the  evaluation  and  maintenance 
release  data.  It  takes  approximately  482  bytes  of  storage  to  add  one 
software  system  (includes  software  system  information,  user/supporter 
baseline  estimate,  and  evaluation  scores).  This  increases  to 
933  bytes  if  the  software  life  cycle  process  low  level  characteristic 
scores  are  included.  It  takes  approximately  163  bytes  for  each  main¬ 
tenance  release  record  that  is  added.  Using  the  total  space 
available  on  the  specific  hard  disk  unit,  you  can  compute  the  limita¬ 
tions  on  the  number  of  evaluations  and/or  maintenance  releases  which 
can  be  added  to  the  disk. 

b.  The  hard  disk  should  have  a  minimum  of  10  megabytes  of  avail¬ 
able  program  work  space  in  order  to  store  system  software,  applica¬ 
tion  software,  data  bases,  and  execute  the  RAMSS  programs. 
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c.  There  is  currently  no  convenient  way  to  transfer  data  from  a 
printed  BMDP  report  directly  to  a  file  which  can  then  be  accessed  by 
dBASE  III.  This  means  the  evaluated  risk  regression  coefficients 
plus  the  estimated  person  months  per  change  regression  coefficients 
computed  by  a  BMDP  program  must  be  manually  transferred  by  the  user 
from  the  printed  BMDP  report  to  dBASE  III  memory  files  (via  a  menu 
screen  entry). 

2.5.5  Error  Processing. 

a.  There  are  several  built-in  and  several  embedded  error  checks 
in  the  application  programs  to  aid  in  the  input  of  data  and  the 
consistency  of  the  data  base  information. 

b.  Checks  built-in  to  dBASE  III  include: 

(1)  Character  fields,  logical  fields,  and  numeric  fields  are 
automatically  checked.  Illegal  (i.e.,  wrong  type)  data 
cannot  be  entered. 

(2)  Numerous  other  built-in  checks  will  depend  upon  what  you 
are  attempting  to  do.  Check  the  dBASE  III  user's  manual 
(reference  1.4.9)  for  more  information. 

c.  Checks  built-in  to  BMDP  include: 

(1)  Data  input  errors  may  cause  BMDP  error  messages  to  be 
printed.  See  the  BMDP  user's  guide  reference  1.4.10  if 
such  error  messages  appear  in  the  BMDP  printed  reports. 

d.  Checks  embedded  within  the  application  program  include: 

(1)  Each  entry  option  (e.g.,  "C"  for  Continue)  is  checked  to 
assure  a  valid  value  has  been  entered.  If  not,  the  menu 
is  displayed  again. 
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(2)  Evaluation  data  and  maintenance  release  data  are 
generally  checked  for  proper  range  limits.  For  example, 
each  evaluation  score  entered  must  be  between  1.00  and 
6.00,  and  is  a  real  value  with  two  decimal  places. 

(3)  Internal  flags  are  maintained  to  determine  which  evalu¬ 
ation  and  maintenance  release  data  are  to  be  "sent"  to 
BMDP  for  use  in  creating  the  risk  regression  equation  and 
the  maintenance  histogram  profiles.  BMDP  performs  addi¬ 
tional  checks  for  missing  and  inconsistent  data  depending 
upon  the  input  commands  in  the  BMDP  command  files. 

(4)  In  order  to  make  sure  the  risk  regression  coefficients  in 

the  dBASE  III  memory  file  RAMFCO.MEM  are  consistent  with 
the  current  evaluation  data,  an  internal  flag  is  main¬ 
tained  in  the  RAMFCO.MEM  memory  file.  When  there  is  any 
change  in  the  status  of  evaluation  data  records  to  be 
included  in  the  analysis,  the  flag  will  be  modified  to 

indicate  invalid.  You  will  see  a  warning  message  on  all 
screens  and  reports  until  a  new  set  of  regression  coef¬ 

ficients  has  been  manually  entered  into  the  RAMFCO.MEM 
memory  file  (via  a  screen  entry).  Likewise,  an  internal 
flag  is  also  maintained  in  the  RAPMCO.MEM  memory  file  to 
make  sure  the  estimated  person-month  per  change  coeffi¬ 
cients  in  RAPMCO.MEM  are  consistent  with  the  current 
maintenance  release  data. 

2.5.6  Flex i bi 1 ity.  There  is  reasonable  flexibility  for  you  to  build 
custom  reports  of  other  combinations  of  data  not  already  output  as 

part  of  the  standard  reports.  You  would  need  to  be  familiar  with  the 
dBASE  III  report  processor  and/or  BMDP  statistical  report  capabili¬ 
ties  and  the  structure  of  the  data  bases.  It  is  possible  to  create 
new  command  file  inputs  for  the  BMDP  program  and  obtain  other  data 

analyses  not  already  being  reported.  Refer  to  section  5.4,  the 
dBASE  III  user's  manual,  and  the  BMDP  user's  manual  for  more  details. 
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2.6  GENERAL  DESCRIPTION  OF  MAJOR  PROCESSES. 


a.  The  RAMSS  allows  you  to  accomplish  four  major  processes: 
assessment  of  software  supportability  risk;  update  of  the  RAMSS  data 


base;  generation  of  RAMSS  reports,  and  system  level  support  such  as 
system  installation,  data  and  program  backup  and  retrieval.  The  risk 
assessment,  data  base  update,  and  report  generation  processes  are 
illustrated  at  a  high  level  in  figure  2-3. 


b.  For  the  risk  assessment  process,  enter  the  user/supporter 
baseline  estimate  data  and  supportability  evaluation  scores.  The 
output  reports  include  up  to  11  dBASE  III  analysis  and  data  reports 
and  2  primary  BMDP  statistical  analysis  reports.  For  the  update  of 
the  analysis  data,  enter  either  supportability  evaluation  data  or 
maintenance  release  data,  execute  a  dBASE  III  program  to  generate 
ASCII  data  files,  and  run  a  BMDP  statistical  program  to  read  the 
ASCII  data  file  and  produce  an  analysis  report.  The  two  primary  BMDP 
analysis  reports  are  the  risk  regression  equation  update  and  the 
maintenance  profile  update.  In  the  case  of  the  regression  equations 
update,  you  are  required  to  manually  transfer  the  resulting  updated 
regression  coefficients  into  dBASE  III  memory  files  for  use  in 
computing  the  software  supportabi 1 i ty  risk  and  estimated  person- 
months  per  change.  These  processes  are  described  in  more  detail  in 
sections  3,  4,  and  5. 


c.  The  system  generation  process  consists  of  two  parts:  proce¬ 
dures  for  installation  of  the  RAMSS  system  and  application  support 
software  on  a  hard  disk;  and  procedures  for  normal  system  start-up, 
shut-down,  and  program  initiation.  There  are  also  some  key  warnings 
and  references  to  the  dBASE  III  user's  manual  (see  reference  1.4.9) 
and  the  BMDP  user's  guide  (see  reference  1.4.10).  Procedures  for 
archival  (backup)  and  recovery  (retrieval)  of  RAMSS  data  and  programs 
between  the  hard  disk  and  a  floppy  disk  are  important  in  order  to 
protect  your  data  from  disk  crashes  or  inadvertent  erasure.  The 
system  generation,  archival,  and  recovery  procedures  are  described  in 
more  detail  in  section  6. 
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SECTION  III 

ASSESS  SOFTWARE  SUPP0RTA8ILITY  RISK 
3.1  ASSESS  SOFTWARE  SUPPORTABILITY  RISK. 

The  process  of  assessing  the  risk  of  supporting  a  software 
system  consists  of  the  following  steps: 

(1)  Step  1:  Enter  software  system  information  data.  In 

order  to  reference  the  software  system,  enter  evaluation 
or  maintenance  data,  and  in  general  assess  risk,  it  is 
necessary  to  enter  some  minimal  identification  data  for 
the  software  system.  This  information  includes  system 
name,  software  system  name,  and  software  system  type 
(i.e.,  ATD,  ATE,  C-E,  EW,  OFP,  SIM,  SUP).  The  RAMSS 
system  automatically  generates  a  software  identification 
number  which  is  subsequently  referenced  for  nearly  all 
data  entry. 

(2)  Step  2:  Build  a  user/supporter  baseline  estimate.  This 
baseline  summarizes  the  general  resources  and  level  of 
support  activity  required  to  maintain  the  subject  soft¬ 
ware  system.  The  creation  of  such  a  baseline  can  be 
assisted  somewhat  by  the  RAMSS  system.  The  baseline 
estimate  data  are  entered  into  the  RAMSS  data  base  for 
computation  of  the  estimated  supportabi 1 ity  risk  and 
future  reference  during  the  software  supportabi  lity 
evaluation. 

(3)  Step  3:  Conduct  the  software  supportabi 1 i ty  evaluations. 
These  evaluations  are  conducted  according  to  the  proce¬ 
dures  described  in  reference  1.4.6  and  1.4.8.  The 
hierarchy  of  software  supportabi 1 ity  evaluation  elements 
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is  shown  in  figure  3-1.  The  following  characteristic 
evaluation  scores  must  be  entered  in  the  range  from  1.00 
to  6.00 

a)  Documentation:  Modularity,  Descriptiveness,  Consis¬ 
tency,  Simplicity,  Expandability,  Instrumentation 

b)  Source  Listings:  Modularity,  Descriptiveness, 

Consistency,  Simplicity,  Expandability,  Instrumenta¬ 
tion 

c)  Personnel:  Management,  Technical,  Support,  Contrac¬ 
tor 

d)  Support  Systems:  Host,  Software  Bench,  Laboratory 

Integrated  Test,  Operational  Integrated  Test, 
Configuration  Management  System,  Other 

e)  Facilities:  General,  Support  Systems 

f)  Project  Management:  Planning,  Organization  Struc¬ 
ture,  Design  Methods,  Code/Implementation  Methods, 
Test  Strategies,  Project  Interfaces 

g)  Configuration  Management:  Identification,  Control, 

Status  Accounting,  Audit/Review 

There  will  be  a  total  of  34  characteristic  evaluation 
scores,  or  possibly  fewer  if  some  of  the  characteristics 
(e.g.,  Support  Systems/other)  do  not  have  evaluation 
scores.  The  scores  for  project  management  and  configura¬ 
tion  management  are  for  the  software  life  cycle  process 
evaluation.  The  RAMSS  support  tool  allows  entry  of  lower 
level  characteristic  scores  and  the  automatic  computation 
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of  the  ten  RAMSS  software  life  cycle  process  evaluation 
scores  (f  and  g  above). 

In  addition  to  the  above  evaluation  scores,  an  overall 
assessment  score  which  is  called  the  software  supporta- 
bility  confidence  must  be  entered.  On  the  basis  of  all 
available  evaluation  data,  software  system  review 
information,  working  group  data,  and  so  forth,  the  soft¬ 
ware  test  manager/deputy  for  software  evaluation  assesses 
the  confidence  that  the  subject  software  system  can  be 
supported  at  the  level  of  activity  indicated  by  the 
user/supporter  baseline  estimate.  This  is  a  real  value 
between  0.00  and  1.00.  This  value  is  only  used  as  part 
of  the  future  risk  regression  equation  update  process 
(see  section  4).  It  is  necessary  to  relate  the  evalua¬ 
tion  scores  to  the  overall  supportabi 1 ity  confidence  in 
order  to  integrate  the  evaluation  into  the  evaluated  risk 
regression  equation  (see  reference  1.4.7). 

(4)  Step  4:  Enter  the  evaluation  scores  into  the  RAMSS  data 
base.  You  enter  the  34  evaluation  scores  plus  the  one 
confidence  assessment  score  into  the  RAMSS  evaluation 
data  base.  If  appropriate,  the  software  life  cycle 
process  low  level  characteristic  (see  reference  1.4.6) 
evaluation  scores  can  be  entered  instead  of  the 
10  characteristic  level  scores. 

(5)  Step  5:  Compute  necessary  hierarchical  evaluation  scores 
and  associated  risk  values.  This  step  does  not  require 
your  direct  participation,  but  is  automatically  done  when 
the  evaluation  data  are  entered. 
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(6)  Step  6:  Generate  RAMSS  analysis  and  data  reports.  There 
are  several  standard  reports  which  can  be  printed  to 
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assist  you  in  understanding  the  computed  software 

supportabi 1 ity  risk.  These  analysis  reports  include: 

a)  A1  -  User/Supporter  Baseline  Estimate  and  Estimated 
Person  Months  per  Change  and  Risk 

b)  A2  -  Table  of  RAMSS  Scores  for  the  Complete  Evalua¬ 
tion  Hierarchy  and  Evaluated  Risk 

c)  A3  -  Chart  showing  percentile  for  each  major  factor 
score  relative  to  all  previous  evaluation  scores 

d)  A4  -  Chart  showing  relative  risk  reduction  potential 
of  each  major  factor  upon  software  supportabi 1 ity 


e)  A5  -  Plot  of  software  supportabi  1  ity  risk  curve  with 
the  evaluation's  estimated  and  measured  risk  values 
displayed  for  each  block  release  of  the  user/ 
supporter  baseline  estimate 


f)  A6  -  Summary  results  of  the  software  system's  risk 
assessment  for  supportability. 

There  are  also  data  reports  which  provide  general  list¬ 
ings  of  raw  data  in  the  RAMSS  date  base,  and  analysis 
reports  generated  by  BMDP  programs.  These  reports  are 
very  valuable  for  an  understanding  of  the  dBASE  III 
analysis  reports.  The  dBASE  III  data  reports  include: 

a)  01  -  List  of  Evaluation  Data 

b)  02  -  List  of  Maintenance  Release  Data 
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c)  D3  -  Table  of  Evaluated  Risk  Regression  Equation 
Coefficients 

d)  D4  -  Table  of  Estimated  Person  Months  Per  Change 
Regression  Equation  Coefficients 

e)  05  -  Table  of  AFOTEC  Parameters  (Threshold/Goal) 

The  BMOP  reports  include: 

a)  81  -  Evaluations:  Initial  Setup  and  Analysis 

b)  82  -  Evaluations:  Histograms  of  Factors  and  Risk 

c)  B3  -  Evaluations:  Risk  Regression  Analysis 

d)  B4  -  Maintenance:  Initial  Setup  and  Analysis 

e)  B5  -  Maintenance  Profile:  All  Releases 

f)  B6  -  Maintenance:  Comparison  of  Software  Type 

Profiles 

g)  87  -  Maintenance:  Regression  Analysis  of  In(PMPC) 

The  procedures  required  to  exercise  the  RAMSS  system  as  part 
of  the  above  steps  are  described  in  the  following  subsections. 


When  you 

execute  the 

RAMSS 

dBASE  III 

program 

(section  6 

describes 

the  process 

of 

initiating 

dBASE  III 

and  BMDP 

programs ) , 

the  Master 

Menu 

screen  1.0 

is  displayed  (see 

appendix  A).  The  necessary  steps  to  assess  the  software  sup- 
portability  risk  can  be  accomplished  using  the  master  menu 
opt  ions . 


THE  BDM  CORPORATION 


BOM/ A-85 -1270-TR 


3.2  UPOATE  EVALUATED  SYSTEM  INFORMATION  DATA. 

The  first  step  to  risk  assessment  is  to  make  sure  there  is  an 
entry  in  the  RAMSS  data  base  for  the  subject  software  system,  and 
that  the  data  are  accurate.  If  there  is  no  entry  for  the  software 
system,  then  it  will  be  necessary  to  create  a  software  system  entry 
by  selecting  option  "S"  from  the  Master  Menu  screen  1.0.  The  system 
information  data  can  then  be  entered.  The  procedure  for  updating  the 
system  information  data  is  described  in  section  4.2. 

3.3  BUILD  USER/SUPPORTER  BASELINE  ESTIMATE. 

a.  The  second  step  to  risk  assessment  is  to  build  a  user/ 

supporter  baseline  estimate.  This  estimate  is  used  to  compute  an 
initial  estimate  of  the  supportabi 1 ity  risk,  and  in  the  conduct  of 

the  supportabi 1 ity  evaluation. 

b.  The  selection  of  option  "8"  from  the  Master  Menu  screen  1.0 

allows  you  to  enter  such  an  estimate.  You  have  some  options  to  help 

in  the  construction  of  a  baseline  estimate.  These  options  are: 

(1)  Enter  data  as  determined  from  user  and  supporter  discus¬ 
sions 

(2)  Select  baseline  estimate  data  from  a  current  maintenance 
release  data  entry 

(3)  Select  baseline  estimate  data  from  the  average  of  current 
maintenance  release  data  of  (1)  the  same  type  as  the 
subject  system  or  (2)  all  systems 

(4)  Select  a  baseline  estimate  entry  from  among  the  current 
baseline  estimate  entries. 
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c.  You  can  build  the  estimate  from  some  combination  of  the  above 
four  options  as  well.  There  are  a  maximum  of  three  block  releases 
for  which  baseline  change  data  can  be  estimated  (practical  limitation 
only) . 

d.  Data  to  be  entered  include  the  support  concept  (e.g.,  number 
of  support  personnel,  length  of  release  cycle),  and  the  baseline 
change  profile  (e.g.,  counts  of  changes  by  type,  complexity, 
priority).  The  process  of  building  a  baseline  estimate  may  evolve 
over  a  considerable  period  of  time.  The  only  requirement  for  risk 
assessment  is  that  the  estimate  be  in  place  prior  to  the  conduct  of 
the  software  supportabi 1 ity  evaluation.  The  detailed  description  of 
the  procedure  for  updating  user/supporter  estimate  data  is  discussed 
in  section  4.3. 

3.4  ENTER  SUPPORTABILITY  EVALUATION  SCORES. 

a.  After  the  software  product,  software  support  facility,  and 
software  life  cycle  process  evaluations  have  been  conducted  (see 
references  1.4.6  and  1.4.8),  the  pertinent  scores  to  the  RAMSS  must 
be  entered  into  the  RAMSS  data  base  using  the  Update  Evaluation  Data 
procedure.  This  is  accomplished  by  selecting  option  "E"  from  the 
Master  Menu  screen  1.0  and  following  the  procedures  discussed  in 
section  4.4. 

b.  You  have  some  options  as  to  the  level  of  detail  at  which  the 
software  life  cycle  process  data  are  entered.  All  that  is  required 
by  the  RAMSS  is  to  enter  the  10  values  for  project  management  and 
configuration  management  described  in  Step  3  of  section  3.1.  How¬ 
ever,  the  lower  level  characteristic  evaluation  scores  for  the  soft¬ 
ware  life  cycle  process  evaluation  can  be  entered  and  the  required 
evaluation  scores  computed  (as  an  average  of  the  lower  level  scores). 
No  weights  are  applied  and  missing  data  are  not  averaged. 
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3.5  COMPUTE  EVALUATION  HIERARCHY  AVERAGES. 

All  levels  of  the  software  supportabi 1 ity  hierarchy  above  the 
characteristic  level  are  automatically  computed  during  entry  of  the 
evaluation  scores.  The  usual  averaging  technique  over  non-missing 
values  is  used.  For  example,  the  documentation  score  is  the  average 
of  modularity,  descriptiveness,  consistency,  simplicity,  expanda¬ 
bility,  and  instrumentation.  Each  of  the  major  factors  described  in 
step  3  of  section  3.1  is  similarly  computed. 

3.6  GENERATE  RISK  ASSESSMENT  REPORTS. 

a.  Risk  assessment  reports  can  be  generated  from  dBASE  III  and 
from  BMDP  programs.  Step  6  of  section  3.1  describes  briefly  the 
11  dBASE  III  reports  and  the  7  BMOP  reports.  The  report  generation 
procedure  and  report  content  are  more  fully  described  in  section  5  and 
appendices  B  and  C.  The  dBASE  III  reports  are  generated  by  selecting 
option  "G"  from  the  Master  Menu  screen  1.0  and  the  subsequent 
options  "A"  or  "0"  from  the  menu  screen  1.7.  The  BMOP  reports  are 
generated  by  BMDP  programs  which  read  ASCII  files  built  by  dBASE  III 
programs.  The  build  of  the  ASCII  files  is  initiated  from  the  menu 
screen  1.7.3. 
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b.  One  critical  interface  between  the  RAMSS  data  base  and  the 
BMDP  reports  must  be  accomplished  manually.  Whenever  the  risk 
regression  equation  is  updated  through  execution  of  a  BMDP  program, 
then  the  risk  regression  coefficients  and  the  constant  term  must  be 
taken  from  the  BMDP  report  and  entered  into  the  RAMSS  data  base.  The 
coefficients  are  entered  into  the  RAMSS  data  base  (actually  a 
dBASE  III  memory  file)  through  selection  of  option  "C"  on  the  Master 
Menu  screen  1.0  followed  by  selecting  option  "V"  on  screen  1.5. 
Likewise,  whenever  the  estimated  person-month  per  change  equation  is 
updated  through  execution  of  a  3MDP  program,  then  the  PMPC  regression 
coefficients,  the  constant  term,  and  the  standard  deviation  must  be 
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taken  from  the  BMDP  report  and  entered  into  the  RAMSS  database. 
These  values  are  entered  through  the  selection  of  option  "C"  on  the 
Master  Menu  Screen  1.0,  followed  by  selecting  option  "P"  on 
screen  1.5.  The  detailed  procedures  for  accomplishing  these  update 
processes  are  described  in  section  4.6. 
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SECTION  IV 


UPOATE  ANALYSIS  DATA 


4.1  INTRODUCTION. 


a.  Updating  analysis  data  primarily  consists  of  the  following 
functions: 


(1)  Entering,  editing,  deleting  evaluation  scores  and  system 
identification  information. 


(2)  Computing  a  new  regression  equation  to  predict  software 
supportabil ity  risk  based  upon  the  evaluation  scores  for 
the  major  factors:  documentation,  source  listings,  per¬ 

sonnel,  support  systems,  facilities,  project  management, 
and  configuration  management.  Such  computation  is 
required  only  if  it  is  desirable  to  integrate  one  or  more 
new  evaluations  or  changes  to  old  evaluations  into  the 
risk  prediction  regression  equation. 


(3)  Entering,  editing,  deleting  maintenance  release  data  and 
system  identification  information. 


(4)  Computing  new  maintenance  profiles  to  reflect  the  addi¬ 
tion,  deletion,  or  modification  of  maintenance  release 


data. 


(5)  Modifying  values  for  evaluation  score  and  risk  assessment 
thresholds  and  goals. 


This  section  describes  the  procedures  necessary  to  accomplish  these 
functions.  These  functions  are  the  basis  for  the  process  described 
in  section  3  for  assessing  the  software  supportabi 1 ity  risk. 
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b.  In  order  to  update  any  of  the  analysis  data  you  must  first 
access  the  menu  screen  from  which  the  update  can  be  selected.  This 
is  accomplished  by  following  the  instructions  in  section  6  for 
initiating  the  execution  of  the  dBASE  III  part  of  the  RAMSS  automated 
support  tool.  The  initial  display  is  a  Master  Menu  which  allows  the 
you  to  select  the  required  update  option.  In  particular,  you  can 
enter  options  to  select  whether  system  information  data  are  to  be 
updated;  user/supporter  baseline  estimate  data  are  to  be  updated; 
evaluation  data  and/or  maintenance  release  data  are  to  be  updated; 
risk  regression  equation  coefficients  are  to  be  updated;  or  AFOTEC  - 
specific  parameters  are  to  be  updated.  The  update  options  are  shown 
below.  The  display  screens  are  described  in  appendix  A. 

(1)  S  -  UPDATE  SYSTEM  INFORMATION  DATA 

(2)  B  -  UPDATE  USER/SUPPORTER  BASELINE  ESTIMATE  DATA 

(3)  E  -  UPDATE  RAMSS  EVALUATION  DATA 

(4)  M  -  UPDATE  MAINTENANCE  RELEASE  DATA 

(5)  C  -  UPDATE  REGRESSION  EQUATION  COEFFICIENTS 

(6)  A  -  UPOATE  AFOTEC  THRESHOLD/GOAL  PARAMETERS 
Sections  4.2  -  4.7  describe  each  of  these  options. 

c.  While  you  are  in  the  dBASE  III  RAMSS  System,  you  may  perform 
functions  which  cause  either  »WARNING  #1«  or  »WARNING  #2<<  to 
appear  on  the  top  line  of  the  screen.  Below  is  a  description  of  what 
these  warnings  indicate: 

WARNING  #1:  Inconsistencies  may  exist  between  current  evalua¬ 
tion  scores  and  the  current  evaluated  risk 
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regression  coefficients.  You  need  to  update 
these  coefficients  by  following  the  procedure 
described  in  section  4.6.2. 

This  message  will  appear  if  you  (1)  modify  or  delete  RAMSS 
evaluation  scores  that  have  been  used  in  computing  the  current 
evaluated  risk  regression  coefficients,  (2)  add  or  modify 
software  life  cycle  process  scores  for  a  system  whose  RAMSS 
evaluation  scores  have  been  used  in  computing  the  current 
evaluated  risk  regression  coefficients,  (3)  delete  a  record 
from  the  system  information  file  (causes  all  associated  data, 
including  evaluation  scores  to  be  deleted)  of  a  system  whose 
RAMSS  evaluation  scores  have  been  used  to  compute  the  current 
evaluated  risk  regression  coefficients,  or  (4)  build  an  ASCII 
file  of  evaluation  data. 

WARNING  #2:  Inconsistencies  may  exist  between  current  main¬ 
tenance  release  data  and  the  current  estimated 
person-months  per  change  regression  coefficients. 
You  need  to  update  thece  coefficients  by  follow¬ 
ing  the  procedure  described  in  section  4.6.4. 

This  message  will  appear  if  you  (1)  modify  or  delete  mainten¬ 
ance  release  data  that  have  been  used  in  computing  the  current 
estimated  person-months  per  change  regression  coefficients, 
(2)  delete  a  record  from  the  system  information  file  (causes 
all  associated  data,  including  maintenance  release  data  to  be 
deleted)  of  a  system  whose  maintenance  release  data  have  been 
used  to  compute  the  current  person-months  per  change  regres¬ 
sion  coefficients,  or  (3)  build  an  ASCII  file  of  maintenance 
release  data. 
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4.2  UPDATE  SYSTEM  INFORMATION  DATA. 

4.2.1  System  Information  Data  Base  Format.  A  complete  format  of  the 
system  information  data  base  is  given  in  appendix  E.  The  functional 
data  fields  include: 

(1)  Software  system  identification  number 

(2)  Creation  date 

(3)  System  name 

(4)  Software  system  name 

(5)  Software  system  type 

(6)  Description  (name)  of  the  user  (using  command) 

(7)  Description  (name)  of  the  supporter  (supporting  command/ 
contractor ) . 

The  system  information  data  base  is  a  dBASE  III  data  base  named 
RASYSI . DBF. 

4.2.2  Update  System  Information  Data  Base. 

a.  A  flow  summary  of  the  procedure  for  updating  system  data  is 
shown  in  appendix  A.  Option  "S"  is  selected  from  the  Master  Menu 
screen  1.0  if  you  desire  to  add,  delete,  or  modify  system  informa¬ 
tion.  You  may  enter  the  update  option,  return  to  the  previous 
screen,  or  exit  to  the  Master  Menu. 

b.  If  a  new  system  entry  is  to  be  added,  you  are  presented  with  a 
screen  of  variables  to  be  defined.  These  variables  include: 
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System  Name 
Software  System  Name 
Software  System  Type 
User  of  Software  System 
Supporter  of  Software  System 
Creation  Date. 

The  System  and  Software  System  names  must  be  a  unique  pair.  If  not, 
then  the  entry  will  not  be  accepted,  and  you  will  be  allowed  to  make 
a  correction  to  the  entry.  If  the  pair  is  unique,  then  a  new  system 
identification  number  is  automatically  generated.  At  this  point,  you 
can  choose  to  save  the  new  record,  edit  any  of  the  information  just 
entered,  or  return  to  the  main  menu  without  saving  the  new  record. 
If  you  save  the  record,  then  screen  1.1  is  again  displayed  for 
further  action. 

c.  If  a  current  system  entry  is  to  be  deleted,  then  you  are 
requested  to  enter  a  valid  software  system  identification  number. 
You  can  get  a  list  of  current  numbers  and  system/software  system 
names  if  you  so  desire.  Upon  entry  of  a  valid  identification  number, 
the  system  information  data  is  displayed  along  with  the  creation  date 
and  whether  any  associated  data  currently  exist  in  the  evaluation 
data  base  and/or  the  maintenance  release  data  base.  You  are 
cautioned  strongly  that  choosing  the  option  to  delete  the  specified 
system  entry  will  cause  the  system  information  data  and  any  asso¬ 
ciated  user/supporter  baseline  estimate  data,  evaluation  data,  and 
maintenance  release  data  to  be  deleted.  Also,  if  the  system  you  are 
deleting  has  evaluation  scores  or  maintenance  release  data  that  have 
been  used  to  compute  either  the  current  evaluated  risk  regression 
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coefficients  or  the  current  person-months  per  change  regression 
coefficients,  these  coefficients  will  no  longer  be  valid.  See 
section  4.1c  for  more  details.  You  are  given  the  option  to  delete 
the  entry  or  return  to  the  previous  screen  without  any  deletion. 
When  the  deletion  is  complete  (if  deletion  was  chosen)  menu 
screen  1.1  again  displayed  for  further  action. 

d.  If  a  current  system  entry  is  to  be  modified,  you  are  requested 
to  enter  a  software  system  identification  number.  Upon  entry  of  a 
valid  software  identification  number,  a  set  of  system  data  is  dis¬ 
played,  and  these  data  may  be  edited.  However,  before  it  is  saved 
via  user  option  selection,  the  system  and  software  system  name  are 
checked  as  a  pair  for  uniqueness.  If  the  pair  is  unique,  then  the 
modified  system  information  data  will  be  saved  in  the  system  informa¬ 
tion  data  base.  Otherwise,  you  will  be  allowed  to  make  a  correction 
to  the  entry.  After  the  data  have  been  saved,  then  menu  screen  1.1 
is  again  displayed  for  further  action. 

e.  It  should  be  emphasized  that  no  risk  assessment  or  data  update 
can  be  done  on  a  software  system  unless  the  system  information  data 
have  been  entered  into  the  system  information  data  base  via  the 
process  described  in  this  section. 

f.  There  will  be  a  delay  when  exiting  from  the  system  information 
data  entry  screen  whenever  a  deletion  of  a  system  has  occurred. 
Thus,  if  several  deletions  are  to  be  done,  it  is  most  efficient  to  do 
them  all  at  once  before  exiting  menu  screen  1.1.  When  you  return  (or 
quit)  from  this  menu  screen,  the  pertinent  data  bases  are  packed 
(physically  removing  the  logically  deleted  records)  and  reindexed  as 
appropriate. 
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4.3  UPDATE  USER/SUPPORTER  8ASELINE  ESTIMATE  DATA. 

4.3.1  User/Supporter  Baseline  Estimate  Data  Base  Format.  The  User/ 
Supporter  8aseline  Estimate  Data  Base  is  completely  described  in 
appendix  E.  The  data  fields  include: 

(1)  Software  system  identification  number 

(2)  Update  date 

(3)  Release  duration 

(4)  Release  overlap 

(5)  Percentage  of  Personnel  dedicated  to  release:  computed 
from  (3),  (4) 

(6)  Number  of  support  personnel 

(7)  Percentage  of  support  personnel  dedicated  to  this  soft¬ 
ware  system 

(8)  Average  skill  level  of  support  personnel 

(9)  Total  number  of  changes,  corrections,  enhancements,  con¬ 

versions,  low  complexity,  medium  complexity,  high 
complexity,  normal  priority,  urgent  priority,  emergency 
priority  for  block  1 

(10)  Total  number  of  changes,  correction,  enhancements,  con¬ 

versions,  low  complexity,  medium  complexity,  high  com¬ 
plexity,  normal  priority,  urgent  priority,  emergency 
priority  for  block  2 


ijl 

/> 


& 

I 

s 

1 


THE  BDM  CORPORATION 


BDH/A-85-1270-TR 


(11)  Total  number  of  changes,  corrections,  enhancements,  con¬ 
versions,  low  complexity,  medium  complexity,  high 
complexity,  normal  priority,  urgent  priority,  emergency 
priority  for  block  3. 

The  User/Supporter  Baseline  Estimate  Data  Base  is  a  dBASE  III  data 
base  named  RAUSBE.D8F. 

4.3.2  Update  User/Supporter  Baseline  Estimate  Data  Base. 


a.  A  flow  summary  of  the  procedure  for  updating  system  data  is 
shown  in  appendix  A.  Option  "B"  is  selected  from  the  Master  Menu 


screen  1.0  if  you  desire  to  add,  delete,  or  modify  user/support  baseline 
estimate  data.  You  can  enter  the  update  option,  return  to  the 
previous  screen,  or  exit  to  the  Master  Menu. 


b.  If  an  entry  is  to  be  added,  you  are  requested  to  enter  a  valid 
software  system  identification  number.  Upon  entry  of  a  valid  identi¬ 
fication  number,  a  screen  of  variables  to  be  defined  is  displayed 
(see  appendix  A).  After  fields  (1)  -  (3)  are  entered,  you  can  then 
enter  (or  have  the  system  generate)  a  baseline  change  profile  for 
each  block  release.  This  is  accomplished  one  block  at  a  time.  Once  you 
choose  to  enter  block  information  (by  entering  "B"  on  screen  1.2.1) 
you  have  5  choices: 

(1)  Enter  block  information  manually 

(2)  Select  block  information  from  maintenance  data  entry 


(3)  Select  block  information  as  an  average  of  maintenance 
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(4)  Select  block  information  from  a  previous  baseline 
estimate 

(5)  Leave  block  information  as  is  (all  zeroes). 

Once  the  block  release  information  is  entered  (or  generated),  you  can 
continue  to  the  next  block.  After  all  three  block  releases  have  been 
entered,  you  can  save  the  new  record,  edit  the  information  that  was 
just  entered,  or  return/quit  without  saving  the  new  record.  If  you 
choose  the  option  to  save  the  record,  available  person-months  per 
change,  estimated  person-months  per  change,  and  estimated  risk  will 
be  calculated  for  each  block  and  displayed  on  the  screen.  You  then 
press  any  key  to  continue  and  screen  1.2  is  again  displayed  for 
further  action. 

c.  If  a  current  entry  is  to  be  deleted,  then  you  are  requested  to 
enter  a  valid  software  system  identification  number.  You  can  get  a 
list  of  current  numbers  and  systam/software  system  names  if  you  so 
desire.  Upon  entry  of  a  valid  identification  number,  the  system's 
user/supporter  baseline  data  are  displayed.  You  are  cautioned 
strong! v  that  choosing  the  option  to  delete  the  specified  entry  will 
cause  the  data  to  be  deleted.  You  are  given  the  option  to  delete  the 
entry  or  return  to  the  previous  screen  without  any  deletion.  When 
the  deletion  is  complete  (if  deletion  was  chosen),  menu  screen  1.2  is 
again  displayed  for  further  action. 

d.  If  a  current  entry  is  to  be  modified,  then  you  are  requested 
to  enter  a  valid  software  system  identification  number.  You  can  get 
a  list  of  current  numbers  and  system/software  system  names  if  you  so 
desire.  Upon  entry  of  a  valid  identification  number,  the  system's 
user/supporter  baseline  data  are  displayed  and  may  be  edited.  After 
fields  (1)  -  (8)  are  edited,  you  can  then  edit  the  baseline  change 
profile  for  each  block  release,  one  at  a  time.  Once  you  choose  to 
edit  block  information  (by  entering  "B"  on  screen  1.2.1)  '  iu  have 
5  choices: 
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(1)  Enter  block  information  manually 

(2)  Select  block  information  from  maintenance  data  entry 

(3)  Select  block  information  as  an  average  of  maintenance 
data 

(4)  Select  block  information  from  a  previous  baseline 
estimate 

(5)  Leave  block  information  as  is. 

Once  the  block  release  information  is  edited,  you  can  then  continue 
to  the  next  block.  After  all  three  block  releases  have  been  edited, 
you  can  save  the  changes,  edit  the  information  just  entered,  or 
return/quit  without  changing  the  record.  If  you  choose  to  save  the 
changes,  available  person-months  per  change,  estimated  person-months 
per  change,  and  estimated  risk  are  recalculated  for  each  block  and 
displayed  on  the  screen.  You  then  press  any  key  to  continue  and 
screen  1.2  is  again  displayed  for  further  action. 

4.4  UPDATING  EVALUATION  ANALYSIS  DATA. 

4.4.1  Evaluation  Analysis  Data  Base  Format. 

a.  The  "Evaluation  Data  3ase"  is  actually  two  data  bases,  both 
linked  by  a  software  system  identif ication  number  with  the  system 
information  data  base.  The  data  bases  are: 

(1)  RAMSS  Evaluation  Data  Base  -  contains  evaluation  scores 
for  RAMSS 

(2)  RAMSS  Software  Cycle  Process  Evaluation  Data  Base  - 

contains  low  ’eve>  characteristic  evaluation  scores  for 
the  software  life  cycle  process  evaluation. 
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A  complete  description  of  these  data  bases  is  given  in  appendix  E. 
b.  The  data  fields  for  the  RAMSS  Evaluation  Data  Base  include: 

(1)  Software  system  identification  number 

(2)  Update  date 

(3)  Use  flag 

(4)  Documentation  score:  average  of  scores  in  (5) 

(5)  Documentation  scores  for  Modularity,  Descriptiveness, 
Consistency,  Simplicity,  Expandability,  and  Instrumenta¬ 
tion 

(6)  Source  listings  score:  average  of  scores  in  (7) 

(7)  Source  listing  scores  for  Modularity,  Descriptiveness, 
Consistency,  Simplicity,  Expandability,  and  Instrumenta¬ 
tion 

(8)  Product  score:  average  of  scores  in  (4)  and  (6) 

(9)  Personnel  score:  average  of  scores  in  (10) 

(10)  Personnel  scores  for  Management,  Technical,  Support,  and 
Contractor 

(11)  Support  systems  score:  average  of  scores  in  (12) 

(12)  Support  systems  scores  for  Host,  Software  Bench, 
Laboratory  Integrated  Test,  Operational  Integrated  Test, 
Conf igurat ion  Management  System,  and  Other  Systems 
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(13)  Facility  score:  average  of  scores  in  (14) 

(14)  Facility  scores  for  General  and  Support  Systems 

(15)  Software  support  resources  score:  average  of  scores  in 
(9),  (11),  (13) 

(16)  Software  configuration  management  score:  average  of 

scores  in  (17) 

(17)  Software  conf iguration  management  scores  for  Identifi¬ 
cation,  Control,  Status  Accounting,  and  Audit/Review 

(18)  Project  management  score:  average  of  scores  in  (19) 

(19)  Project  management  scores  for  Planning,  Organization 
Structure,  Design  Methods,  Code/Implementation  Methods, 
Test  Strategies,  and  Project  Interfaces 

(20)  Software  life  cycle  process  score:  average  of  scores  in 
(16),  (18) 

(21)  Software  supportabi 1 ity  score:  average  of  scores  in  (8), 
(15),  (20) 

(22)  Software  supportabi 1 ity  confidence  score 

(23)  Software  supportabi 1 ity  evaluated  risk  (computed  from 
risk  regression  equation). 

Fields  (17)  and  (19)  can  either  be  entered  directly  or  computed  as 
averages  of  the  lower  level  scores  in  the  software  life  cycle  process 
data  base.  If  the  lower  level  scores  exist,  fields  (17)  and  (19) 
will  be  computed  from  the  lower  level  scores  and  cannot  be  edited. 
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The  RAMSS  Evaluation  Data  Base  is  a  dBASE  III  data  base  named 
RAEVAL. DBF. 

c.  The  data  fields  for  the  Software  Life  Cycle  Process  Evaluation 
Data  Base  include: 


(1)  Software  system  identification  number 

(2)  Update  date 

(3)  Software  configuration  management  score  for  Identifi¬ 

cation:  average  of  scores  in  (4) 

(4)  40  Identification  scores 

(5)  Software  configuration  management  scores  for  Control: 

average  of  scores  in  (6) 

(6)  40  Control  scores 

(7)  Software  configuration  management  score  for  Status 

Accounting:  average  of  scores  in  (8) 

(8)  40  Status  Accounting  scores 

(9)  Software  configuration  management  scores  for  Audit/ 

Review:  average  of  scores  in  (10) 

(10)  40  Audit/Review  scores 

(11)  Software  project  management  score  for  Planning:  average 
of  scores  in  (12) 

(12)  40  Planning  scores 
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(13)  Software  project  management  scores  for  Organization: 
average  of  scores  in  (14) 

(14)  40  Organization  scores 

(15)  Software  project  management  scores  for  Oesign  methods: 
average  of  scores  in  (16) 

(16)  40  Design  Method  scores 

(17)  Software  project  management  scores  for  Implementation 
methods:  average  of  scores  in  (18) 

(18)  40  Implementation  Method  scores 

(19)  Software  project  management  scores  for  Test  Strategies: 
average  of  scores  in  (20) 

(20)  40  Test  Strategy  scores 

(21)  Software  project  management  scores  for  Project  inter¬ 
faces:  average  of  scores  in  (22) 

(22)  40  Project  Interface  scores. 

d.  The  characteristic  scores  for  the  major  factors  of  configura¬ 
tion  management  and  project  management  are  automatically  transferred 
to  the  same-named  fields  in  the  RAMSS  evaluation  Data  Base  after 
these  values  are  computed  from  the  lower  level  characteristic  evalua¬ 
tion  scores.  The  Software  Life  Cycle  Process  Evaluation  Data  Base  is 
a  dBASE  III  data  base  named  RASLCP.DBF. 
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4.4.2  Updating  Evaluation  Analysis  Data  Base. 

a.  A  flow  summary  of  the  procedure  for  updating  evaluation 
analysis  data  is  shown  in  appendix  A.  If  option  "E"  is  selected  from 
the  Master  Menu  screen  1.0,  then  a  menu  screen  1.2  will  be  displayed 
which  indicates  you  desire  to  add,  delete,  or  modify  data  in  the 
RAMSS  evaluation  Oata  Base  or  the  Software  Life  Cycle  Process 
Evaluation  Oata  Base.  You  can  enter  the  update  option,  return  to  the 
previous  screen,  or  exit  to  the  beginning  introductory  screen. 

b.  If  an  update  option  is  entered,  you  will  be  prompted  to  enter 
a  software  system  identification  number.  If  you  want  to  see  a  list 
of  existing  systems,  enter  0.  Upon  entry  of  a  valid  identification 
number,  screen  1.3.1  will  be  displayed.  At  this  point  you  may  choose 
to  update  the  RAMSS  Evaluation  database  (RAEVAL)  or  the  Software  Life 
Cycle  Process  Evaluation  data  base  (RASLCP). 

c.  If  the  RAMSS  Evaluation  data  base  is  selected  for  update  (by 
entering  option  "E"  on  screen  1.3.1),  one  of  three  processes  will  be 
performed  depending  on  the  update  option  you  selected  on  screen  1.3: 

(1)  Add  Data 

If  the  evaluation  data  are  being  created  for  the  selected 
software  system,  the  field  names  are  displayed  with 
default  values  of  0.  You  may  then  enter  scores  for  all 
editable  fields.  After  entering  the  scores,  you  may  save 
the  new  data,  edit  the  scores  just  entered,  do  a 
"what-if"  analysis,  or  quit/return  without  saving  the  new 
data.  If  you  save  the  new  data,  the  computed  higher- 
level  scores  will  be  displayed,  along  with  the  evaluated 
risk  and  the  new  record  will  be  written  to  the  RAEVAL 
database.  The  "what-if"  analysis  allows  you  to  enter 
evaluation  scores  in  order  to  compute  evaluated  risk 
without  actually  saving  the  values  to  the  data  base. 
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( 2)  Modify  Existing  Data 

If  you  are  modifying  existing  evaluation  data,  the  field 
names  are  displayed  with  their  current  values.  You  may 
then  enter  scores  for  all  editable  fields.  If  the  system 
has  Software  Life  Cycle  Process  Evaluation  data,  you  will 
not  be  able  to  edit  the  Project  Management  or  Configura¬ 
tion  Management  scores.  After  all  the  scores  have  been 
entered,  you  may  save  the  new  values,  edit  the  scores 
just  input,  do  a  "what-if"  analysis,  or  quit/return 
without  saving  the  new  values. 

It  is  important  to  note  that  if  the  evaluation  data  that 
you  are  modifying  have  been  used  in  computing  the  current 
evaluated  risk  regression  equation  coefficients,  any 
changes  to  the  scores  that  are  saved  make  these  coeffi¬ 
cients  invalid.  You  will  need  to  follow  the  procedures 
outlined  in  section  4.6.2  to  update  the  risk  regression 
coefficients.  Warning  #1  message  will  appear  on  all 
screens  and  reports  until  you  have  updated  the  coeffi¬ 
cients.  See  section  4.1c.  for  more  details. 

The  "what-if"  analysis  allows  you  to  change  evaluation 
scores  without  actually  changing  the  values  in  the  RAEVAL 
data  base.  This  option  can  be  used  to  see  what  happens 
to  the  evaluated  risk  when  scores  are  changed. 

(3)  Delete  Data 

If  evaluation  data  are  to  be  deleted,  the  field  names  are 
displayed  along  with  the  current  evaluation  scores  for 
the  selected  software  system.  You  will  be  asked  if  these 
are  the  evaluation  data  that  you  wish  to  delete.  If  the 
evaluation  data  that  you  are  deleting  have  been  used  to 
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compute  the  current  evaluated  risk  regression  coeffi¬ 
cients,  these  coefficients  will  be  invalidated. 
Warning  #1  message  will  appear  on  all  screens  and  reports 
until  you  have  updated  these  coefficients.  See 
section  4.1c  for  more  details.  If  you  respond  in  the 
affirmative,  the  record  will  be  marked  for  deletion; 
otherwise,  the  record  will  not  be  deleted  and  you  will  be 
returned  to  screen  1.3. 

d.  If  the  Software  Life  Cycle  Process  Evaluation  data  base  is 
selected  for  update  (by  entering  option  "P"  on  screen  1.3.1), 
processing  continues  based  upon  the  update  option  you  selected  as 
screen  1.3. 

(1)  Add  Data 

If  you  choose  to  add  data  to  the  Software  Life  Cycle 
Process  Evaluation  data  base  (RASLCP),  there  must  already 
be  a  record  for  the  selected  system  in  the  RAMSS  Evalua¬ 
tion  data  base  (RAEVAL).  If  there  is  not,  you  will  get 
an  error  message  and  will  not  be  allowed  to  enter  new 


If  the  selected  system  does  have  RAMSS  Evaluation  data, 
screen  1.3. 1.3  will  be  displayed.  You  may  then  choose 
which  of  the  10  software  life  cycle  process  categories 
you  wish  to  enter  scores  for.  Screen  1.3. 1.3.1  will  then 
be  displayed  which  allows  up  to  40  scores  to  be  entered. 
These  scores  must  be  integer  values  in  the  range  1-6. 
After  the  scores  are  entered,  you  may  save  the  new 
scores,  edit  the  scores  just  entered,  or  quit/return 
without  saving  the  new  values.  If  you  save  the  scores, 
you  will  be  returned  to  screen  1.3. 1.3.  You  continue 
entering  scores  until  you  have  done  so  for  each  of  the 
categories  you  desire. 
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(2)  Modify  Existing  Data 

If  you  are  modifying  existing  data  in  the  Software  Life 
Cycle  Process  Evaluation  data  base,  processing  is  done  as 
in  the  second  paragraph  in  the  previous  section 
(4.4.2.d.l). 

It  is  important  to  note  that  if  the  evaluation  data  for 
the  selected  system  were  used  in  computing  the  current 
evaluated  risk  regression  coefficients,  addition  or 
modification  of  a  record  in  the  Software  Life  Cycle 
Process  Evaluation  data  base  will  make  these  coefficients 
invalid.  You  will  need  to  follow  the  procedure  outlined 
in  section  4.6.2  to  update  the  risk  regression  coeffi¬ 
cients.  Warning  #1  message  will  appear  on  all  screens 
and  reports  until  you  have  updated  the  coefficients.  See 
section  4.1c.  for  more  details. 

(3)  Delete  Data 

If  Software  Life  Cycle  Process  Evaluation  data  are  to  be 
deleted,  the  system  information  of  the  selected  software 
system  will  be  displayed  on  screen  1.3. 1.4.  You  will  be 
asked  if  this  is  the  system  for  which  you  wish  to  delete 
Software  Life  Cycle  Process  Evaluation  data.  If  you 
answer  "Y",  the  record  will  be  marked  for  deletion; 
otherwise,  the  record  will  not  be  deleted  and  you  will  be 
returned  to  screen  1.3. 

e.  When  the  data  are  saved,  all  computed  fields  will  be  automati¬ 
cally  updated.  No  data  are  saved  except  by  explicitly  entering  the 
save  option.  If  the  option  to  delete  the  evaluation  data  is 
selected,  then  an  additional  warning  is  displayed  as  a  precaution, 
and  you  must  verify  that  a  deletion  is  indeed  desired.  There  may  be 
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some  delay  in  processing  a  deletion  request  so  that  data  bases  can  be 
repacked  and  reindexed  as  is  necessary.  This  is  not  done  until  you 
leave  screen  1.3. 

4.5  UPOATE  MAINTENANCE  RELEASE  OATA. 

4.5.1  Maintenance  Release  Data  Base  Format. 

a.  The  Maintenance  Release  Oata  Base  is  linked  by  software  system 
identif ication  number  to  the  system  information  data  base.  The 
Maintenance  Release  Data  Base  contains  one  or  more  records  of  main¬ 
tenance  release  data  for  the  reported  software  systems.  Each  release 
data  record  is  identified  by  a  release  identification  number.  A  more 
complete  discussion  of  this  data  base  is  given  in  appendix  E. 

b.  The  data  fields  for  the  Maintenance  Release  Data  Base  include: 


(1) 

Software  system  identification  number 

(2) 

Release  identification  number 

(3) 

Update  date 

(4) 

Use  flag 

(5) 

Number  of  source  lines  in  system 

at  current  release 

(6) 

Percentage  of  source  lines  which 

are  HOL 

(7) 

Primary  source  language 

(8)  Number  of  direct  software  system  support  personnel 
(group  1,  group  2) 
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(9)  Average  skill  level  (1..5)  of  personnel  (group  1, 
group  2) 

(10)  Percentage  of  personnel  dedicated  to  this  software  system 
as  opposed  to  other  software  systems  (group  1,  group  2) 

(11)  Percentage  of  personnel  time  dedicated  to  this  software 
system  release  as  opposed  to  other  releases  of  this  same 
software  subsystem  (group  1,  group  2) 

(12)  Release  start  date 

(13)  Release  engineering  completion  date 

(14)  Release  fielded  date 

(15)  Release  engineering  duration:  computed  from  fields  (12), 
(13) 

(16)  Available  person-month  effort  for  engineering  release 
duration  (computed  from  assigned  personnel  data) 

(17)  Estimated/Actual  person-months  for  engineering  release 
duration 

(18)  Total  number  of  change  requests  incorporated  in  this 
release 

(19)  Total  number  of  change  requests  which  are  corrections 

(20)  Total  number  of  change  requests  which  are  enhancements 

(21)  Total  number  of  change  requests  which  are  conversions 
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(22)  Total  number  of  change  requests  which  are  low  complexity 

(23)  Total  number  of  change  requests  which  are  medium 
complexity 

(24)  Total  number  of  change  requests  which  are  high  complexity 

(25)  Total  number  of  change  requests  which  are  normal  priority 

(26)  Total  number  of  change  requests  which  are  urgent  priority 

(27)  Total  number  of  change  requests  which  are  emergency 
priority. 

c.  These  data  fields  correspond  to  or  are  computed  from  data 
fields  on  the  recommended  site  maintenance  data  collection  form  in 
reference  1.4.5.  The  Maintenance  Release  Data  Base  is  a  dBASE  III 
data  base  named  RARLSE.DBF. 

d.  A  completed  example  maintenance  data  collection  form  is  shown 
in  figure  4-1.  To  see  how  to  go  from  this  form  to  the  data  entry 
screen  1.4.1,  follow  through  the  example  below  (data  base  fields  are 
indicated) : 

(5)  Number  of  source  lines  -  60 

(6)  Percent  HOL  -  85  percent  (FORTRAN  -  80  percent  + 

command/control  -  5  percent.) 

(7)  Primary  Language  -  FORTRAN 

Group  1  DATA 


(8)  Number  of  persons  -  26  (3  +5+7+9+  2) 
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COMPUTER  SOFTWARE  RELEASE  OATA  RECORD 


1.  SITE 

WR-ALC 


5.  SIZE  (K  UNES) 


2.  SYSTEM 

JTIDS 


6.  LANGUAGE 


3.  SOFTWARE  SYSTEM 

lass  II  Terminal 


NAME  %  SOURCE  UNES 

FORTRAN  80% 

ASSEMBLY  15% 

COMMAND/CONTROL  5% 
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4.  SOFTWARE  SYSTEM  TYPE 

C-E 


HOUY/N) 

Y 


I  7.  PERSONNEL 

#  ORGANIC 

%  DEDICATED 

#  CONTRACTOR 

%  DEDICATED 

(LOWEST) 

SKILL  LEVEL  1. 

3 

40% 

SKILL  LEVEL  2. 

5 

50% 

SKILL  LEVEL  3. 

7 

50% 

NA 

SKILL  LEVEL  4. 

9 

30% 

(HIGHEST) 

SKILL  LEVEL  5. 

2 

50% 

8.  RELEASE  ID/VERSION 

9.  RELEASE  START  OATE 

VI. 0 

July  1,  1988 

10.  RELEASE  ENGINEERING 
COMPLETION  DATE 


IfcKfcl 


11.  RELEASE  FIELD  OATE 


May  15,1989 


12.  RELEASE  CHANGE  OATA  (USE  AOOITIONAL  ATTACHMENTS  AS  NECESSARY) 


CHANGE  REQUEST 

OPEN 

CLOSE 

ACTU 

IO 

OATE 

OATE 

PERSON  M 

S100 

4/1/88 

3/15/89 

2.0 

S101 

4/1/88 

3/15/89 

1.0 

S104 

5/1/88 

3/15/89 

1.0 

S105 

5/5/88 

3/15/89 

2.0 

S110 

5/9/88 

3/15/89 

3.0 

S 1 1 2 

6/10/88 

3/15/89 

2.0 

S 1 1 3 

7/1/88 

3/15/89 

1.0 

S120 

7/15/88 

3/15/89 

8.0 

S135 

7/20/88 

3/15/89 

1.0 

SI  36 

7/20/88 

3/15/89 

1.0 

SI  37 

7/20/88 

3/15/89 

1.0 

S138 

7/20/88 

3/15/89 

7.0 

S140 

7/20/88 

3/15/89 

1.0 

S141 

7/31/88 

3/15/89 

2.0 

S142 

7/31/88 

3/15/89 

2.0 

S143 

8/1/88 

3/15/89 

1.0 

S148 

8/1/88 

3/15/89 

2.0 

S150 

10/1/88 

3/15/89 

1.0 

S152 

12/1/88 

3/15/89 

1.0 

COMPLEXITY 

(L.M.H) 


PRIORITY 

(W.U.t) 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

N 

U 

U 


AFOTEC  FORM XXXX 
SEP  85 


JS-0510-TT)  W  1 11.01 


Figure  4-1.  Recommended  Software  Release  Data 
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(9)  Average  skill  -  2.98 
Full  time  equivalent 

=  (3*. 40)  +  (5*. 50)  +  (7*. 50)  +  (9*. 30)  +  (2*. 50) 
=  1.2  +  2.5  +  3.5  +  2.7  +  1.0 
=  10.9 

Total  skill 

=  (1.2*1)  +  (2.5*2)  +  (3.5*3)  +  (2.7*4)  +  (1.0*5) 
=  1.2  +  5.0  +  10.5  +  10.8  +  5.0 
=  32.5 


Average  skill 
=  32.5/10.9 
=  2.98 

(10)  Percent  personnel  dedicated  to  system  -  42 


%  ded  =  Full  time  equivalent/#  of  persons 
=  10.9/26 
=  .4192 

(11)  Percent  personnel  dedicated  to  release  =  100 

Group  2  DATA  (NA) 

(12)  Start  date  -  07/01/88 

(13)  Engineering  completion  date  -  03/15/89 


’14)  Field  release  date  -  05/15/89 


(17)  Actual  effort  in  person-months  -  40.0  (add  person-months 
for  all  change  requests) 
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(18) 

Total  number  of  change  requests  -  19  (Count  all  change 
requests) 

(19) 

#  of  correction  requests  -  17  (Change 

Type  =  "C") 

requests 

with 

(20) 

#  of  enhancement  requests  -  2  (Change 
Type  =  "H") 

requests 

wi  th 

(21) 

#  of  conversion  requests  -  0  (Change  requests  with  Type  = 
"V") 

(22) 

#  of  low  complexity  changes  -  14  (Change 
complexity  =  "L") 

requests 

wi  th 

(23) 

#  of  medium  complexity  changes  -  3  (Change 
complexity  =  "M") 

requests 

wi  th 

(24) 

#  of  high  complexity  changes  -  2  (Change 
complexity  =  " H ") 

requests 

with 

(24) 

#  of  normal  priority  changes  -  17  (Change 
priority  =  "N") 

requests 

wi  th 

(26) 

#  of  urgent  priority  changes  -  2  (Change 
priority  =  "U") 

reques  ts 

wi  th 

(27) 

i  of  emergency  priority  changes  -  0  (Change 

requests 

with 

priority  =  "E"). 

4.5.2  Update  Maintenance  Release  Data  Base. 


a.  A  flow  summary  of  the  procedure  for  updating  maintenance 
release  data  is  shown  in  appendix  A.  If  option  "M"  is  selected  from 
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the  Master  Menu  screen  1.0,  then  menu  screen  1.4  is  displayed  to 
indicate  your  desire  to  add,  delete,  or  modify  data  in  the  RAMSS 

Maintenance  Release  Data  Base.  You  can  enter  the  update  option, 

return  to  the  previous  screen,  or  exit  to  the  Master  Menu  screen. 

b.  If  a  new  maintenance  release  record  is  to  be  added,  you  must 

enter  a  valid  software  identification  number.  You  can  get  a  list  of 
current  numbers  and  system/software  system  names  if  you  so  desire. 
Upon  entry  of  a  valid  identification  number,  you  are  prompted  to 
enter  a  release  10.  This  release  ID  must  be  unique  for  the  particu¬ 
lar  system  selected.  You  can  get  a  list  of  current  release  IDs  for 
the  selected  system  if  you  wish.  Upon  entry  of  a  valid  release  ID,  a 
screen  of  variables  is  displayed.  You  may  then  enter  the  new 

information.  After  data  entry  is  complete,  you  can  save  the  new 

record,  edit  the  information  that  was  just  entered,  or  return/quit 
without  saving  the  record. 

c.  If  a  current  maintenance  release  entry  is  to  be  deleted,  then 

you  are  requested  to  enter  a  valid  software  system  identification 
number.  You  can  get  a  list  of  current  numbers  and  system/software 
system  names  if  you  so  desire.  Upon  entry  of  a  valid  identification 
number,  you  are  prompted  to  enter  the  release  ID  of  the  maintenance 

release  record  to  be  deleted.  You  can  get  a  list  of  current  release 

IDs  for  the  selected  system  if  you  wish.  Upon  entry  of  a  valid 
release  ID,  the  selected  system  is  displayed.  You  will  be  asked  if 
this  is  the  record  you  wish  to  delete.  If  the  maintenance  release 
data  that  you  are  deleting  have  been  used  to  compute  the  current 
estimated  person-months  per  change  regression  coefficients,  these 
coefficients  will  be  invalidated.  Warning  #2  message  (see 

section  4.1.c)  will  appear  on  all  screens  and  reports  until  you  have 

updated  these  coefficients.  If  you  choose  to  delete  the  record,  it 
is  marked  for  deletion  and  screen  1.4  is  again  displayed  for  further 
action. 
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d.  If  a  current  maintenance  release  entry  is  to  be  modified,  you 
must  enter  a  valid  (existing)  software  identification  number.  Enter  0 
to  get  a  list  of  current  numbers  and  system/software  system  names. 
Upon  entry  of  a  valid  identification  number  you  are  prompted  to  enter 
a  release  ID.  You  can  get  a  list  of  current  release  IDs  for  the 
selected  system  if  you  so  desire.  Upon  entry  of  a  valid  release  ID, 
screen  1.4.3  is  displayed.  This  screen  contains  the  variables  and 
existing  values  for  the  record  selected.  You  may  now  edit  the  infor¬ 
mation.  After  editing  is  complete,  you  can  save  the  changes,  or 
quit/return  without  saving  the  changes.  It  is  important  to  note  that 
if  the  maintenance  release  data  that  you  are  modifying  were  used  in 
computing  the  current  estimated  PMPC  regression  equation  coeffi¬ 
cients,  any  changes  that  you  save  will  make  these  coefficients 
invalid.  You  will  have  to  follow  the  procedures  outlined  in 
section  4.6.4  to  update  the  coefficients.  Warning  #2  message  will 
appear  on  all  screens  and  reports  until  you  update  the  coefficients. 

4.6  UPDATE  REGRESSION  EQUATION  COEFFICIENTS. 

4.6.1  Evaluated  Risk  Regression  Coefficients  Memory  File  Format. 

a.  The  Risk  Regression  Coefficients  memory  file  format  is  more 


completely 

described  in  appendix  E. 

The  data  variables  include 

(1) 

Update  date 

(2) 

Invalid  flag 

(3) 

Coefficient  for  constant 

term 

(4) 

Coefficient  for  criteria: 

Life  Cycle  Process 

(5) 

Coefficient  for  criteria: 

Product 

KO 


y  V*  vv  ‘.^Vbnrywy- 


THE  BDM  CORPORATION 


B0M/A-85-1270-TR 


(6)  Coefficient  for  major  factor:  Personnel 

(7)  Coefficient  for  major  factor:  Support  Systems 

(8)  Coefficient  for  major  factor:  Facilities. 

b.  The  Risk  Regression  Coefficient  file  is  a  dBASE  III  memory 

file  named  RAMFCO.MEM. 

4.6.2  Update  Evaluated  Risk  Regression  Coefficients. 

a.  The  Master  Menu  screen  1.0  contains  an  option  "G"  to  generate 
RAMSS  reports.  One  aspect  of  this  report  generation  is  building  an 
ASCII  file  from  the  evaluation  data  base  which  is  used  by  BMDP  to 
compute  new  risk  regression  coefficients.  The  risk  regression 
equation  is  used  to  compute  the  software  supportabil ity  risk  from  the 
software  supportabi 1 ity  evaluation  scores. 

b.  The  procedure  for  updating  the  risk  regression  equation  is 

summarized  below: 

(1)  Step  1:  Make  sure  all  updates  to  evaluation  data  are 

complete  (see  section  4.4.2  for  update  details). 

(2)  Step  2:  After  selecting  option  "G"  on  the  Master  Menu, 

select  option  "B"  on  the  menu  screen  1.7  to  build  an 
ASCII  file  for  input  to  BMDP.  You  then  select  option  "E" 
to  build  an  ASCII  file  of  evaluation  data. 
Screen  1.7. 3.1  will  allow  you  to  choose  whether  to 

include  or  exclude  a  system's  evaluation  data  prior  to 
the  actual  build.  The  system  ID,  system  name,  and  soft¬ 
ware  system  name  are  listed  for  each  record  in  the  RAMSS 
evaluation  data  base  (RAEVAL),  starting  from  the  end  of 
the  file.  If  you  want  to  include  the  evaluation  record 


I V -27 


THE  BOM  CORPORATION 


30M/A-35-1270-TR 


in  the  analysis,  enter  .T.  in  the  "USE  FOR  ANALYSIS" 
column  of  the  screen  for  that  record;  otherwise,  enter 
.F.  (The  reason  the  records  are  listed  in  reverse  order 
is  that  the  most  recently  added  records  are  at  the  end  of 
the  file.)  The  temporary  ASCII  file  created  is  named 
RAASCIIE.DAT. 

(3)  Step  3:  Exit  from  the  dBASE  III  application  program  and 
execute  the  program  EVAL.DAT  by  entering  "EVAL".  This 
program  will  invoke  8MDP  programs  that  read  the  ASCII 
file,  compute  the  statistics  necessary  for  the  risk 
regression  equation,  and  output  three  BMDP  reports  that 
can  be  printed.  You  can  print  all  three  reports  by 
entering  "PRT  EVAL",  or  you  can  print  one  at  a  time  by 
using  the  DOS  print  command: 

IEVAL1D.0UT 
EVAL5D.0UT 
EVAL1R.0UT 

(4)  Step  4:  You  must  manually  locate  in  the  printed  report 
the  regression  coefficients  for  the  two  criteria  and 
three  major  factors  and  the  linear  regression  equation 
constant  term  (intercept).  These  values  can  be  found  on 
page  3  of  the  Risk  Regression  Analysis  Report  (EVAL1R). 
See  section  5.3  and  appendix  C  for  specific  details  on 
where  to  find  these  six  terms. 

(5)  Step  5:  Reenter  dBASE  III,  execute  the  dBASE  III  RAMSS 
application  program  (enter  DO  RAMSS),  and  select  option 
"C"  from  the  Master  Menu  screen  1.0  followed  by  selecting 
"V"  on  screen  1.5  to  update  the  current  evaluated  risk 
regression  equation  coefficients. 
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(6)  Step  6:  Enter  the  new  set  of  six  risk  regression 

equation  parameters  in  the  respective  variables  shown  on 
the  screen  when  the  "V"  option  is  selected. 

(7)  Step  7:  Save  the  parameters  and  exit  dBASE  III. 

c.  It  should  be  noted  that  an  internal  flag  is  set  in  the  risk 
regression  coefficients  memory  file  (RAMFCO.MEM)  whenever  the  BUILD 
process  described  in  step  2  is  completed.  As  long  as  this  flag  is 
set,  any  further  risk  assessments  that  are  done  will  contain  incon¬ 
sistencies.  This  flag  is  reset  when  the  update  of  the  regression 
coefficients  as  described  in  steps  5-7  is  complete.  You  should  take 
care  to  extract  the  correct  coefficient  data  from  the  BMDP  printed 
report  and  enter  these  data  in  the  correct  data  fields  as  described 
in  steps  4  and  6. 

d.  The  printed  report  output  from  BMDP  should  be  analyzed  to 
assure  that  the  regression  equation  and  the  supporting  statistical 
data  support  the  use  of  the  new  equation's  regression  coefficients  to 
predict  software  supportabil ity  risk.  Discussion  of  these  reports 
and  appropriate  analysis  is  contained  in  section  5.3  and  appendix  C. 

4.6.3  Estimated  Person-Months  Per  Change  Regression  Coefficients 

Memory  File  Format^ 

a.  The  Estimated  Person-Months  Per  Change  (PMPC)  Regression 
Coefficients  memory  file  format  is  completely  described  in 
appendix  E.  The  data  variables  include: 

(1)  Update  date 

(2)  Inval id  flag 

(3)  Coefficient  for  constant  term 
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(4)  Coefficient  for  average  skill 

(5)  Coefficient  for  percent  type  correction 

(6)  Coefficient  for  percent  complexity  low 

(7)  Coefficient  for  percent  complexity  high 

(8)  Coefficient  for  percent  priority  normal 

(9)  Coefficient  for  system  type  ATD 

(10)  Coefficient  for  system  type  ATE 

(11)  Coefficient  for  system  type  C-E 

(12)  Coefficient  for  system  type  EW  1 

(13)  Coefficient  for  system  type  OFP. 

b.  The  PMPC  Regression  Coefficient  file  is  a  dBASE  III  memory 
file  named  RAPMCO.MEM. 

4.6.4  Update  Estimated  Person  Months  Per  Change  Regression 
Coefficients. 

a.  The  Master  Menu  screen  1.0  contains  an  option  "G"  to  generate 
RAMSS  reports.  One  aspect  of  this  report  generation  is  building  an 
ASCII  file  from  the  maintenance  release  data  base  which  is  used  by 
BMDP  to  compute  new  PMPC  regression  coefficients. 

b.  The  procedure  for  updating  the  PMPC  regression  equation  is 
summarized  below: 
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(2)  Step  2 


(3)  Step  3 
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Make  sure  all  updates  to  maintenance  release 

data  are  complete  (see  section  4.5.2  for  update 
details) . 

After  selecting  option  "G"  on  the  master  menu, 
select  option  "B"  on  the  menu  screen  1.7  to 
build  an  ASCII  file  for  input  to  BMDP.  You  then 
select  option  “M"  to  build  an  ASCII  file  of 
maintenance  release  data.  Screen  1.7. 3. 2  will 
allow  you  to  choose  whether  to  include  or 

exclude  a  system's  maintenance  release  data 
prior  to  the  actual  build.  The  system  ID, 

release  ID,  system  name,  and  software  system 
name  are  listed  for  each  record  in  the  mainten¬ 
ance  release  data  base  (RARLSE),  starting  from 
the  end  of  the  file.  If  you  want  to  include  the 
maintenance  release  record,  enter  .T.  in  the 
"USE  FOR  ANALYSIS"  column  of  the  screen  for  that 
record;  otherwise,  enter  .F.  (The  reason  the 

records  are  listed  in  reverse  order  is  that  the 
most  recently  added  records  are  at  the  end  of 
the  file.)  The  temporary  ASCII  file  created  is 
RAASCIIM.DAT. 

Exit  from  the  dBASE  III  application  program  and 
execute  the  program  MAINT.BAT  by  entering 
"MAINT."  This  program  will  invoke  BMDP  programs 
that  read  the  ASCII  file,  compute  the  statistics 
necessary  for  the  PMPC  regression  equation,  and 
output  four  BMDP  reports  that  can  be  printed. 
You  can  print  all  four  reports  by  entering  "PRT 
MAINT"  or  you  can  print  one  at  a  time  by  using  the 
DOS  print  command: 
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print\  bmdp\ramssV 


MAINT1D.0UT 

MAINT5P.0UT 

MAINT7D.0UT 

MAINT2R.0UT 


(4)  Step  4:  You  must  manually  locate  in  the  printed  report 

the  regression  coefficients  for  the  evaluated 
PMPC  variables,  the  linear  regression  equation 
constant  term  (intercept),  and  the  standard 
deviation  (STD. ERROR  OF  EST.).  These  values  can 
be  found  on  page  3  of  the  Regression  Analysis  of 
LN(PMPC)  Report  (MAINT1R).  See  section  5.3  and 
appendix  C  for  more  details  on  where  to  find 
these  terms. 

(5)  Step  5:  Reenter  d8ASE  III,  execute  the  dBASE  III  RAMSS 

application  program  (enter  "DO  RAMSS"),  and 
select  option  "C"  from  the  master  menu  followed 
by  entering  option  "P"  on  screen  1.5  to  update 
the  current  estimated  person-months  per  change 
regression  equation  coefficients. 

(6)  STEP  6:  Enter  the  new  set  of  PMPC  regression  equation 

parameters  on  screen  1.5.2. 

(7)  STEP  7:  Save  the  new  parameters  and  exit  DBASE  III. 

It  should  be  noted  that  an  internal  flag  is  set  in  the  estimated 

person-months  per  change  memory  file  (RAPMCO.MEM)  whenever  the  build 
process  as  described  in  Step  2  is  completed.  As  long  as  this  flag  is 
set,  any  further  risk  assessments  that  are  done  will  contain  incon¬ 
sistencies.  This  flag  is  reset  when  the  update  of  the  regression 
coefficients  as  described  in  Steps  5-7  is  complete. 
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4.7  UPDATE  AFOTEC  THRESHOLO/GOAi.  PARAMETERS. 

4.7.1  Threshold/Goal  Parameter  Memory  File  Format. 

a.  The  data  fields  for  the  AFOTEC  parameter  file  include: 

(1)  Update  date 

(2)  Evaluation  score  threshold  value 

(3)  Evaluation  score  goal  value 

(4)  Risk  assessment  threshold  value 


(5)  Risk  assessment  goal  value. 

b.  The  AFOTEC  parameter  file  is  a  dBASE  III  memory  file  named 
RAAFTH.MEM. 

4.7.2  Update  Threshold/Parameters. 

a.  A  flow  summary  of  the  procedure  for  updating  threshold/goal 
parameters  is  shown  in  appendix  A.  If  option  "A"  is  selected  from 
the  Master  Menu  screen  1.0,  then  you  are  presented  with  screen  1.6 
containing  the  current  values  for  the  AFOTEC  parameters  which  can 
then  be  changed.  You  may  enter  an  option  to  save  the  values,  return 
to  a  previous  screen  (without  saving  the  parameters),  or  quit  to  the 
master  menu  (without  saving  the  parameters).  These  values  are  only 
used  in  the  output  reports  to  discriminate  between  evaluation  and 
risk  values  which  are  high,  medium,  and  low. 
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SECTION  V 

GENERATE  RAMSS  REPORTS 

5.1  INTRODUCTION. 

One  of  the  key  functions  of  the  RAMSS  system  is  the  generation 
of  analysis  and  data  reports.  The  reports  can  be  grouped  into  three 
categories:  d8ASE  III  reports;  8MDP  reports;  and  user  developed 

custom  reports.  Examples  of  reports  in  the  first  two  categories  are 
included  in  appendices  8  and  C,  respectively. 

5.2  GENERATE  dBASE  III  RAMSS  REPORTS. 

a.  From  the  Master  Menu  screen  1.0  you  can  select  the  option  "G" 
to  generate  RAMSS  reports.  The  resulting  menu  screen  1.7  of  options 
allows  you  to  generate  two  classes  of  dBASE  III  reports:  risk 

assessment  evaluation  analysis  reports  and  data  base/file  reports. 
The  first  class  of  reports  is  selectable  when  option  "A"  on 
screen  1.7  is  entered  and  includes: 

(1)  A1  -  User/Supporter  Baseline  Estimate  and  Estimated 

Person  Months  Per  Change  and  Risk 

(2)  A2  -  Table  of  RAMSS  Scores  for  the  Complete  Evaluation 

Hierarchy  and  Evaluated  Risk 

(3)  A3  -  Chart  showing  percentile  for  each  major  factor  score 

relative  to  all  previous  evaluations  scores.  Page  1  is 

relative  to  all  systems,  page  2  is  relative  to  system  of 
the  same  type  as  evaluated  system 

(4)  A4  -  Chart  showing  relative  risk  reduction  potential  of 

each  major  factor  upon  software  supportabil ity  risk 
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(5)  A5  -  Plot  of  software  supportabi  1  ity  risk  curve  with  the 
evaluation's  estimated  and  measured  risk  values  displayed 
for  each  block  release  of  the  user/supporter  baseline 
estimate 

(6)  A6  -  Summary  results  of  the  software  system's  risk 
assessment  for  supportabi lity. 

After  you  select  which  risk  assessment  evaluation  analysis  reports 
are  to  be  printed,  you  will  be  prompted  to  enter  the  software  identi¬ 
fication  10  of  the  system  on  which  the  reports  will  be  based. 
Evaluation  reports  A3,  A4,  and  A5  all  require  computation  time; 
therefore,  if  you  have  selected  any  of  these  three  reports,  you  will 
notice  that  printing  will  stop  periodically. 

b.  The  second  class  of  reports  is  selectable  when  option  "D"  on 
screen  1.7  is  entered  and  includes: 

(1)  D1  -  List  of  Evaluation  Data 

(2)  D2  -  List  of  Maintenance  Release  Data 

(3)  03  -  Table  of  Evaluated  Risk  Regression  Equation  Coeffi¬ 
cients 

(4)  04  -  Table  of  Estimated  PMPC  Regression  Equation  Coeffi¬ 
cients 

(5)  05  -  Tab’e  of  AFOTEC  Parameters  (Threshold/Goal). 

5.3  GENERATE  BMOP  RAMSS  REPORTS. 

a.  There  are  two  groups  of  reports  generated  by  BMDP  for  RAMSS. 
The  first  group  of  reports  is  generated  by  BMDP  programs  that  read  an 
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ASCII  file  of  evaluation  data;  the  second  group  of  reports  is 
generated  by  BMDP  programs  that  read  an  ASCII  file  of  maintenance 
release  data. 

b.  Three  output  files  are  produced  by  running  the  batch  file 
"EVAL"  (EVAllDs4fuT,  EVAL5D.0UT,  and  EVAL1R.QUT) .  You  can  print  all 
three  of  these  files  by  entering  the  command  "PRT  EVAL"  (from  the 
root  directory  of  the  RAMSS  hard  disk  in  drive  C).  The  reports  that 
are  printed  are: 

B1  -  Evaluations:  Initial  Setup  and  Analysis 
82  -  Evaluations:  Histograms  of  Factors  and  Risk 
B3  -  Evalautions:  Risk  Regression  Analysis 

Another  option  is  to  print  one  report  at  a  time.  You  would  do  this 
by  using  the  DOS  "PRINT"  Command.  The  three  output  files  are  located 
in  the  \BMDP\RAMSS  directory: 

(  EVAL1D.0UT 


c>  PRINT  \8M0P\RAMSS\ '  EVAL5D. OUT 

I  EVAL1R.0UT 


c.  Four  output  files  are  produced  by  running  the  batch  file 
"MAINT"  (MAINT1D. OUT,  MAINT5D.0UT,  MAINT7D.0UT,  MAINT1R.0UT) .  You 
can  print  all  four  of  these  files  by  entering  "PRT  MAINT"  (from  the 
root  directory  of  the  RAMSS  hard  disk  in  drive  C).  The  reports  that 
are  printed  are: 

B4  -  Maintenance:  Initial  Setup  and  Analysis 
B5  -  Maintenance  Profiles:  All  Releases 
B6  -  Maintenance:  Comparison  of  Software  Type  Profiles 
37  -  Maintenance:  Regression  Analysis  of  In(PMPC) 
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Another  option  is  to  print  one  report  at  a  time.  You  would  do  this 
by  using  the  00S  "PRINT"  command.  The  four  output  files  are  located 
in  the  \BMDP\rAMSS  directory: 


PRINT  \BMDP\RAMSS\ 


MAINT1D.0UT 

MAINT5D.0UT 

MAINT1D.0UT 

MAINT1R.0UT 


5.4  GENERATE  CUSTOM  REPORTS. 

Refer  to  the  dBASE  III  user's  manual  (reference  1.4.9)  and  the 
BMDP  user's  manual  (reference  1.4.10)  for  more  details  on  generating 
custom  reports. 
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SECTION  VI 

SYSTEM  GENERATION,  ARCHIVAL,  AND  RECOVERY 

6.1  INTRODUCTION. 

a.  This  section  describes  the  following  system  generation 
procedures: 

(1)  Installation  of  the  RAMSS  application  software  and 
dBASE  III  and  BMDP  system  software  on  a  hard  disk 

(2)  Deinstallation  off  a  hard  disk 

(3)  Execution  of  RAMSS  dBASE  III  programs 

(4)  Execution  of  BMOP  programs. 

b.  Archival  and  recovery  procedures  include: 

(1)  Backup  and  recovery  of  RAMSS  on  hard  disk 

(2)  Back  up  and  recovery  of  RAMSS  data  bases  on  floppy 
diskettes. 

6.2  SYSTEM  GENERATION. 

6.2.1  System  Assumptions/Hardware  Configuration. 

a.  In  order  to  run  the  RAMSS  System,  you  must  have  an  IBM  PC/AT 
CPU  (or  compatible)  with  (1)  640  K  memory  and  a  floating  point 
coprocessor,  (2)  one  floppy  disk  drive,  (3)  one  hard  disk  drive 
(Bernoulli ) . 
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b.  The  executable  RAMSS  software  is  contained  entirely  on  one 
Bernoulli  hard  disk.  The  Bernoulli  hard  disk  is  configured  as 
follows: 


DBASEIII 


RAMSS  PGMS  RAMSS 


(1)  The  root  directory  (C:)  should  contain  the  DOS  batch 
files  used  by  RAMSS.  (See  section  6.2.4).  The  root 
directory  also  contains  the  system  files  (as  a  result  of 
formatting  the  Bernoulli),  and  the  Bernoulli  utilities. 

(2)  The  SYS  directory  should  contain  the  following  files 
(copied  from  DOS  3.10  system  diskette): 

•  .  „  _  Of* 


VDISK  .SYS 


(3)  8M0P  programs  should  be  installed  in  the  C:\BMDP\PGMS 
directory.  (See  section  6.2.3). 


•.rw-'.v.v.v.v.vv 
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(4)  dBASE  III  should  be  installed  in  the  C:\DBASEIII\PGMS 
directory.  (See  section  6.2.2). 

(5)  BMDP  control  files  should  be  in  the  C:\BMDP\RAMSS 
directory.  (See  section  6.2.4). 

(6)  dBASE  III  program  files,  report  format  files,  memory 
files,  data  bases,  and  index  files  should  be  in  the 
C:\dBASEIIl\RAMSS  directory.  (See  section  6.2.4). 


6.2.2  Installation  of  dBASE  III  on  the  Hard  Disk, 


dBASE III  is 


installed  onto  the  Bernoulli  hard  disk  in  directory  C:\DBASEIIl\PGMS. 
Follow  the  steps  below  to  accomplish  the  installation: 

(1)  Make  C:\D8ASE 1 1 I^PGMS  the  default  directory: 

c>  cd\d8aseiii\pgms 

or 

A>  CD  C:\08ASEIIl\pGMS 

(2)  Set  the  default  drive  to  the  floppy  drive: 

C>  A: 

(3)  Insert  the  dBASE  III  System  Disk  #1  in  drive  A  and  type 
the  following  command: 


A>  INSTALL  C: 


<RETURN> 


(4)  You  will  see  the  Hard  Disk  Installation  Screen.  Press 
any  key  to  continue. 
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(5)  You  will  see  a  message  that  tells  you  how  many  installa¬ 
tions  are  available  on  this  disk.  Press  <RETURN>  as 
prompted. 

(6)  When  prompted,  insert  the  dBASE  III  System  Disk  #2  in 
drive  A,  and  press  a  key  when  you  are  ready.  When  the 
files  finish  copying,  remove  System  Disk  #2  from  drive  A. 

dBASE  III  is  now  installed  on  your  hard  disk  in  the  directory 
C:\JBASEIII\PGMS. 

See  the  dBASE  III  Manual,  page  4-5  of  "Getting  Started  in  dBASE  III 
Version  1.1"  for  complete  installation  instructions. 


6.2.3  Installation  of  BMDP  on  the  Hard  Disk. 


(1)  Insert  the  BMDP  Master  diskette  into  drive  A. 


(2)  Copy  the  BMDP.BAT,  BMDPRUN.BAT,  BMDPINIT.CSD,  and 
BMDPF2D.EXE  files  from  the  BMDP  Master  diskette  to  the 
\BMDP\PGMS  directory  of  the  hard  disk: 


COPY  A: BM0P.BAT 
COPY  A: BMDPRUN.BAT 
COPY  A : BMDP I N IT . CSD 
COPY  A:BMDPF2D.EXE 


C:\BMDP\PGMS 

C:\BMDP\PGMS 

C:\BMDP\PGMS 

C:\BMDP\PGMS 


(3)  Set  the  default  directory  to  BMDP  PGMS: 


>CD  C:\BMDP\PGMS 


(4)  You  will  be  using  the  BMDP  copy  program  (BMDPF2D)  for 
copying  the  individual  BMDP  programs  from  the  diskette  to 
the  hard  disk. 
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a)  Insert  the  ID  diskette  into  drive  A. 


b)  Type  the  following: 


C>  BMDPF2D 


<RETURN> 


Enter  the  drive  letter: 
a  <RETURN> 

Repeat  a  and  b  above  for: 
o  20  diskette 
o  60  diskette 
o  7D  diskette 
o  4F  diskette 
o  2R  diskette 
o  50  diskette 
o  1R  diskette 

See  "BMDPC:USER'S  Guide  to  BMDP  on  the  IBM  PC"  page  3-5  for  complete 
installation  instructions. 


6.2.4  Installation  of  RAMSS  Application  Software  from 
Floppy  Diskettes. 


a.  The  RAMSS  application  software  includes: 

(1)  DOS  batch  files 

(2)  BMDP  control  files 

(3)  dBASE  III  program  files,  report  format  files,  memory 
files,  and  RAMSS  data  bases  (with  associated  index 
files). 
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b.  The  00$  batch  files  and  the  BMDP  control  files  are  stored  on 
the  diskette  labeled  RAMSS1.  The  DOS  batch  files  should  be  copied 
from  RAMSS1  to  the  root  directory  of  the  Bernoulli  disk.  These  batch 
files  all  have  the  extension  .BAT,  so  you  can  use  the  COPY  command  as 
follows: 


COPY  A:*. BAT  C:  \ 

c.  The  BMDP  control  files  and  8MDP.LOG  should  be  copied  from  the 
RAMSS1  diskette  to  the  C:\BMDP\RAMSS  directory  of  the  Bernoulli  disk. 
The  control  files  all  have  the  extension  .CTL,  so  you  can  use  the 
COPY  command  as  follows: 

COPY  A:*. CTL  C:\8MDP\RAMSS 

e.  The  dBASE III  files  are  contained  on  two  diskettes:  RAMSS2  and 
RAMSS3.  RAMSS2  contains  the  dBASE 1 1 1  program  files.  RAMSS3  contains 
the  RAMSS  data  bases,  index  files,  memory  files,  and  report  format 
files.  All  files  on  both  of  these  diskettes  should  be  copied  to  the 
C:\DBASEIII\RAMSS  directory  of  the  Bernoulli  disk.  This  can  be 
accomplished  by  entering  the  COPY  command  as  follows  (one  diskette  at 
a  time) : 


COPY  A:*.*  C:\D8ASEIII\RAMSS 
(See  the  00S  manual  for  complete  COPY  instructions.) 

6.2.5  Deinstallation  Procedures. 

a.  Once  you  have  installed  dBASE  III  on  the  hard  disk,  it  can 
only  be  used  on  that  hard  disk.  The  floppy  diskettes  from  which 
dBASE  III  was  installed  are  no  longer  functional.  If  it  becomes 
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necessary  to  uninstall  dBASE  III  off  the  hard  disk  for  some  reason, 
follow  the  instructions  below. 

(1)  Set  the  default  drive  to  the  floppy  drive  (A). 

(2)  Insert  the  dBASE  III  system  diskette  #1  in  drive  A.  (Be 
sure  the  hard  disk  is  in  drive  C).  At  the  A>  prompt, 
enter  the  following: 

A>  UNINSTAL  C: 

(3)  You  will  see  the  UNINSTAL  Procedure  screen.  Press  any 
key  to  continue. 

(4)  You  will  see  a  message  telling  you  how  many  installations 
are  available  after  uninstall  is  complete.  Press 
<RETURN>. 

b.  See  the  dBASE  III  manual,  page  5-6  of  "Getting  Started  in 
dBASE  III  Version  1.1"  for  complete  uninstall  instructions. 

6.2.6  Execution  of  RAMSS  Application  Programs. 

a.  In  order  to  boot  the  RAMSS  system,  put  the  RAMSS  hard  disk  in 
drive  C.  (If  operating  system  not  on  hard  disk,  use  the  RAMSS  system 
diskette  in  drive  A.)  If  the  system  is  on,  press  CTl-ALT-DEL; 
otherwise,  turn  the  system  on.  You  will  see: 

IOMEGA  Bernoulli  Box  (tm)  Vera.  2.3:  Port  330H  -  2  drives 
A>ECHO  OFF 

Welcome  to  RAMSS 

(Risk  Assessment  Methodology  for  Software  Supportability ) 
Options : 

-  Enter  "DB"  to  access  RAMSS  data  bases  and  dBASE  III 

-  Enter  "EVAL"  to  run  BMDP  analyses  of  evaluation  data 

-  Enter  "MAINT"  to  run  BMDP  analyses  of  maintenance  data 

-  Enter  "PRT  EVAL"  to  print  BMDP  evaluation  output 

-  Enter  "PRT  MAINT"  to  print  BMDP  maintenance  output 
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You  are  in  the  root  directory  of  the  hard  disk  (drive  C).  The  five 
choices  that  are  displayed  will  invoke  DOS  batch  routines.  You  may 
enter  "RAMSS"  any  time  you  have  a  DOS  prompt  (e.g.,  C>)  to  get  back 
to  the  root  directory  and  redisplay  the  5  choices. 

b.  DB.  Choose  "DB"  if  you  wish  to  access  dBASE  III.  You  would 
do  this  if  you  want  to  (1)  enter  software  system  information,  evalua¬ 
tion  scores,  user/supporter  baseline  estimate  information,  or  main¬ 
tenance  release  information,  (2)  generate  dBASE  III  risk  assessment 
analysis  reports  or  database/f i le  reports,  (3)  build  ASCII  files  to 
be  used  by  BMDP,  (4)  enter  new  evaluated  risk  or  estimated  person- 
months  per  change  regression  coefficients,  or  (5)  update  AFOTEC 
metric  boundaries. 

After  you  enter  "DB",  you  will  see 

OECHO  OFF 

RAMSS  Data  Base  Access 

NOTE:  Once  dBASE  has  been  accessed,  enter  "DO  RAMSS" 

Strike  a  key  when  ready  .  .  . 


At  this  point,  press  any  key  to  continue.  dBASE  III  is  loaded  and 
the  following  screen  is  displayed: 
dBASE  III  version  1.10  IBM/MSDOS  *** 

COPYRIGHT  (c)  ASHTON-TATE  1984 

AS  AN  UNPUBLISHED  LICENSED  PROPRIETARY  WORK. 

ALL  RIGHTS  RESERVED. 

Use  of  this  software  and  the  other  materials  contained  in  the  software  package 
(the  "Materials")  has  been  provided  under  a  Software  License  Agreement  (please 
read  in  full).  In  summary .  Ashton-Tate  grants  you  a  paid-up,  non-transf errable 
personal  license  to  use  the  Materials  only  on  a  single  or  subsequent  (but  not 
additional)  computer  terminal  for  fifty  years  from  the  time  the  sealed  disk 
has  been  opened.  You  receive  the  right  to  use  the  Materials,  but  you  do  not 
become  the  owner  of  them.  You  may  not  alter,  decompile,  or  reverse-assemble  th 
software,  and  YOU  MAY  NOT  COPY  the  Materials.  The  Materials  are  protected  by 
copyright,  trade  secrets,  and  trademark  law,  the  violation  of  which  can  result 
in  civil  damages  and  criminal  prosecution. 

dBASE,  dBASE  III  and  ASHTON-TATE  are  trademarks  of  Ashton-Tate. 

Press  the  FI  key  for  help 

Type  a  command  (or  ASSIST)  and  press  the  return  key  (DY). 
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At  the  .  prompt,  enter  "00  RAMSS".  A  "welcome"  screen  is  displayed. 
Enter  "C"  to  continue  and  the  RAMSS  Master  Menu  is  displayed.  You 
are  now  ready  to  do  whatever  RAMSS  processing  is  required. 

When  you  are  ready  to  exit  dBASE  III,  enter  "QUIT"  from  the  . 
prompt.  You  will  be  returned  to  the  C>  prompt. 

c.  EVAL.  Choose  “EVAL"  if  you  want  to  run  BMDP  analyses  of 
evaluation  data.  You  would  do  this  only  after  you  have  built  an 
ASCII  file  of  evaluation  data  within  the  dBASE  III  RAMSS  systems 
(option  "E"  on  screen  1.7.3). 

After  you  enter  "EVAL",  you  will  see: 

OECHO  OFF 

RAMSS  Software  Evaluation  Analysis 
******************************************** 

*  Place  BMDP  MASTER  diskette  in  drive  A:  * 
******************************************** 

Strike  a  key  when  ready  .  .  . 

Put  the  BMDP  Master  diskette  in  drive  A  and  press  <RETURN>  to  begin 
processing.  You  will  see  the  BMDP  output  on  the  screen  as  it  is 
produced.  After  processing  is  complete,  you  will  be  returned  to  the 
C>  prompt. 

d.  PRT  EVAL.  Choose  "PRT  EVAL"  after  you  have  run  "EVAL".  The 
three  output  files  produced  by  EVAL  will  be  printed.  After  you  enter 
"PRT  EVAL",  you  will  see: 

OECHO  OFF 

Ready  to  print  BMDP  output  files  EVAL*. OUT 
Ensure  that  printer  is  ready 
Strike  a  key  when  ready  .  .  . 

Press  any  key  and  the  three  reports  will  be  printed. 


e.  MAINT.  Choose  "MAINT"  if  you  want  to  run  BMDP  analysis  of 
maintenance  release  data.  You  would  do  this  only  after  you  have 
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built  an  ASCII  file  of  maintenance  release  data  within  the  dBASE  III 
RAMSS  system  (option  "M"  on  screen  1.7.3).  After  you  enter  "MAI NT", 
you  wiT1  see: 

OECHO  OFF 

RAMSS  Software  Maintenance  Analysis 
******************************************** 

*  Place  BMDP  MASTER  diskette  in  drive  A:  * 
******************************************** 
Strike  a  key  when  ready  .  .  . 

Put  the  8M0P  Master  diskette  in  drive  A  and  press  <RETURN>  to  b - 3 i n 
processing.  You  will  see  the  BMDP  output  on  the  screen  as  it  is 
being  produced.  After  processing  is  complete,  you  will  be  returned 
to  the  C>  prompt. 


f.  PRT  MAINT.  Choose  "PRT  MAINT"  after  you  have  run  MAINT.  The 
four  output  files  produced  by  MAINT  will  be  printed.  After  you  enter 
"PRT  MAINT",  you  will  see: 


OECHO  OFF 

Ready  to  print  BMDP  output  files  MAINT*. OUT 
Ensure  that  printer  is  ready 
Strike  a  key  when  ready  .  .  . 


Press  any  key  and  the  four  reports  will  be  printed. 

6.3  ARCHIVAL  AND  RECOVERY. 

6.3.1  Backup  and  Recovery  of  RAMSS  on  Hard  Disk.  Because  of  the 
difficulty  of  reconstructing  data  that  may  be  lost  due  to  power 
failure,  disk  damage,  or  other  unforseen  problems,  it  is  recommended 
that  you  periodically  back  up  your  RAMSS  hard  disk.  The  fastest  and 
easiest  way  to  do  this  is  to  copy  your  entire  hard  disk  to  another 
(back-up)  hard  disk.  The  procedure  for  doing  this  is  as  follows: 

(1)  Make  sure  your  RAMSS  hard  disk  is  in  drive  C,  and  a 
formatted  Bernoulli  hard  disk  is  in  drive  D. 


j  M*  JU»  A 
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(2)  Type  the  following  command: 

OI0MEGA  COPY  <RETURN> 

(If  IOMEGA  Bernoulli  Box  is  version  2.3,  after  the  A> 
prompt,  type  I COPY  C:  0:).  You  will  see  the  COPY  screen. 
The  target  drive  is  C:  and  the  source  drive  is  D.  Enter 

the  appropriate  information  and  continue  with  the  copy 

process. 

(See  the  IOMEGA  Bernoulli  Box  Manual  for  more  information  on  the 
IOMEGA  utility.) 

6.3.2  Backup  and  Recovery  of  RAMSS  Data  Bases  on  Floppy  Diskettes. 

a.  Your  RAMSS  Bernoulli  hard  disk  contains  DOS  batch  files,  DOS 
command  files,  BMDP  program  and  control  files,  dBASE  III  program 
files,  memory  files,  report  format  files,  and  RAMSS  data  bases  with 
associated  index  files.  Of  all  of  these  files,  the  RAMSS  data  base 
files,  index  files,  and  memory  files  are  the  only  files  that  change 
as  a  result  of  user  activity.  Because  of  this,  it  is  recommended 
that  you  periodically  copy  these  files  from  the  Bernoulli  hard  disk 

to  back-up  floppy  diskettes.  The  files  you  need  to  copy  are 

(contained  in  the  C:\d8ASEIIl\RAMSS  directory): 

RASYSI .DBF,  RASYSI ID.NDX,  RASYSISS.NDX 

RAUSBE.OBF,  RAUSBEID.NOX 

RAEVAL.DBF,  RAEVALID.NDX 

RASICP.DBF,  RASLCPID.NOX 

RARLSE.DBF,  RARLSEID.NDX,  RARISESR.NDX 

RAMFCO.MEM 

RAPMCO.MEM 

RAAFTH.MEM 


VI-11 


raw 
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b.  If  it  becomes  necessary  to  restore  from  the  back-up  diskettes, 
simply  copy  these  files  from  the  floppy  diskette  to  the 
C:\dBASE  1 1 1\ RAMSS  directory  of  the  Bernoulli  disk. 

c.  See  the  DOS  manual  for  instructions  on  copying  files  from  one 
drive  to  another. 
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A.  Example  Display  Screens 
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APPENOIX  A 

EXAMPLE  DISPLAY  SCREENS 

A.l  INTRODUCTION. 

a.  The  RAMSS  automated  tool  support  is  controlled  by  simple  menu 
driven  display  screens.  Each  of  the  screens  is  presented  in  this 
appendix  in  hierarchical  order  along  with  a  brief  explanation  of 
features  of  the  screen  in  a  "storyboard"  style. 

b.  There  are  some  general  characteristics  of  all  screens.  You 
can  always  exercise  the  option  "R"  to  return  to  the  previous  screen 
or  "Q"  to  quit  to  the  Master  Menu  screen  first  displayed  when  the 
dBASE  III  RAMSS  automated  support  system  is  exercised  by  entering  "DO 
RAMSS".  See  section  6  for  a  more  detailed  description  of  the  system 
generation  and  program  initiation  procedures. 

c.  The  top  line  of  the  display  screen  always  contains  a  title, 
current  date  and  screen  number.  The  second  line  usually  contains 
system  information  (when  a  specific  system  identification  number  has 
been  selected).  Lines  3  through  22  are  for  application  information. 
Lines  23  and  24  are  reserved  for  entering  options  and  displaying 
error  messages.  Any  error  messages  are  self-explanatory  and  usually 
refer  to  invalid  user  input. 

d.  A  pictorial  view  of  the  display  screen  hierarchy  is  shown  in 
figure  A-l. 
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A. 2  DISPLAY  SCREENS. 

This  section  presents  each  display  screen  on  one  page  with  a 
storyboard  description  of  the  functions  and  procedures  which  can  be 
exercised  through  the  display  screen. 
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modify  an  existing  record  in  the  RAUS13E  data  base.  After  entering  values  for  the  Support 
cept,  you  can  enter  block  information  (B),  return  to  screen  1.2  (R),  or  return  to  the  Master 
j  (Q).  If  you  select  option  B,  screen  1.2. 1.1  will  be  displayed.  This  screen  will  be  redis- 
yed  after  each  block  of  information  is  entered. 
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APPENDIX  8 

EXAMPLE  dBASE  III  RAMSS  REPORTS 


8.1  INTRODUCTION. 

a.  The  dBASE  III  reports  are  selected  for  output  from  a  display 
screen  and  support  the  process  of  assessing  software  supportability 
risk.  You  must  select  the  option  "G"  from  the  Master  Menu 
screen  1.0.  The  resulting  display  screen,  1.7,  will  allow  you  to 
enter  option  "A"  or  option  ‘"D".  If  option  "A"  is  selected  from  menu 
screen  1.7,  then  the  following  printed  report  selections  are  dis- 
p 1 ayed : 

(1)  User/Supporter  Baseline  Estimate 

(2)  Table  of  Evaluation  Scores 

(3)  Line  Chart  of  Major  Factor  Percentiles 

(4)  Line  Chart  of  Major  Factor  Risk  Reduction  Potential 

(5)  Plot  of  Risk  Curve  for  all  Systems  and  all  Systems  of  the 
Same  Type  as  the  Selected  System 

(6)  Summary  RAMSS  Report. 

Once  you  have  made  your  selections,  you  will  be  prompted  to  enter  the 
software  identification  number  of  the  system  for  which  the  reports 
are  to  be  printed.  These  printed  reports  are  used  in  the  assessment 
of  the  software  system's  supportabi  1  ity.  There  are  many  other  custom 
reports  which  could  be  generated  using  the  built-in  dBASE  III  report 
capability.  Five  such  reports  can  be  generated  by  selecting 

option  "D"  from  menu  screen  1.7.  The  following  printed  report 
options  are  displayed: 
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(1)  Evaluation  Data  8ase  Raw  Data 

(2)  Maintenance  Release  Data  Base  Raw  Data 

(3)  Evaluated  Risk  Regression.  Equation 

(4)  Estimated  Person  Months  Per  Change  Regression  Equation 

(5)  AFOTEC  Threshold/Goal  Parameters. 

b.  A  pictorial  view  of  the  display  screen  hierarchy  for  generat¬ 
ing  dBASE  III  and  BMDP  reports  is  shown  in  figure  B-l. 

B.2  dBASE  III  RAMSS  REPORTS. 

This  section  presents  an  example  of  each  dBASE  III  RAMSS 
report  on  one  page  with  an  example  of  the  report  format  and  an  over¬ 
view  of  the  report  content. 
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RISK  1 - 

ASSESSMENT  ANALYSIS 
V.  REPORT  OPTIONS  . 
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BMDP 
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figure  8-1.  Hierarcny  of  3AMS5  OBASt  III  Report  Generation 
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EVALUATION  REPORT  A1 :  USER  /SUPPORTER  BASELINE  CONCEPT 
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the  risk  reduction  poteritidl  for  that  major  factor.  This  value  is  plot 
line  of  asterisks  and  also  printed  along  the  right  hand  edge  of  the  report. 
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APPENDIX  C 

EXAMPLE  BMDP  RAMSS  REPORTS 

C.l  INTRODUCTION. 

a.  The  BMDP  RAMSS  Reports  can  be  printed  after  executing  BMDP 

programs  which  read  ASCII  files  of  data  built  from  either  the  data 
base  of  evaluation  scores  or  the  data  base  of  maintenance  release 
data.  This  process  of  generating  the  proper  ASCII  files  from  a 
dBASE  III  program  is  described  in  section  5.2  and  appendix  B.  The 
ASCII  file  of  evaluation  scores  (one  record  per  software  system)  is 
named  RAASCIIE.DAT.  The  ASCII  file  of  maintenance  release  data  (one 
record  per  software  system  release)  is  named  RAASCIIM.DAT. 

b.  The  DOS  batch  file  that  prints  the  BMDP  RAMSS  reports  is  PRT. 

To  print  the  reports  generated  from  analysis  of  evaluation  data, 
enter  "PRT  EVAL"  from  the  C>  prompt.  To  print  the  reports  generated 
from  analysis  of  maintenance  release  data,  enter  "PRT  MAINT"  from  the 
C>  prompt.  See  section  5.3  for  complete  details  for  printing  the 
BMDP  RAMSS  reports. 

c.  A  graphic  view  of  the  flow  process  to  generate  BMDP  reports  is 
shown  in  figure  C-l. 

C.2  BMDP  RAMSS  REPORTS. 

This  section  presents  excerpts  from  an  example  of  each  BMDP 
RAMSS  report  along  with  appropriate  explanation  of  the  printed 
output.  In  the  sections  below,  page  numbers  will  be  referred  to; 
these  appear  in  the  upper  left-  or  right-hand  corners  of  the  output 

pages  in  the  form  "PAGE  1".  On  page  1  of  every  example  output 

appears  the  BMDP  program  control  information  that  produced  the  out¬ 
put.  The  program  control  information  starts  with  "/PROB"  and  ends 
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with  "/END".  For  details  on  the  control  information,  refer  to  the 
section  for  a  given  program  (e.g.,  ID)  in  the  BMDP  Statistical  Soft¬ 
ware  manual . 

C.2.1  Evaluation  Report  B1  (See  Figure  C-2). 

a.  This  output  is  produced  by  the  control  file  EVAL1D.CTL,  which 
primarily  reads  the  ASCII  data  file  RAASCIIE.DAT  and  sets  up  a 
so-called  SAVE  file  which  becomes  the  data  file  used  for  analysis. 
Initial  variables  are  read,  labelled,  and  checked  for  valid  values. 
Additional  variables  are  computed  and  stored  in  the  SAVE  file.  The 
SAVE  file  is  named  EVAL.SAV.  Pages  1  and  2  of  the  output  document 
the  setup  process. 

b.  On  page  3  begins  a  table  of  the  data  stored  in  the  SAVE  file. 
The  "MISSING"  entries  denote  data  elements  for  which  missing  data 
codes  occurred  in  the  RAMSS  data  base.  The  case  labels  are  actually 
software  system  identification  numbers  (SWSYSID). 

c.  A  table  of  summary  statistics  (mean,  standard  deviation,  etc.) 
for  the  data  appears  on  page  7.  The  total  frequency  column  indicates 
the  number  of  cases  (records)  for  which  valid  values  of  the  corre¬ 
sponding  variable  were  available. 
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C.2.2  Evaluation  Report  82  (See  Figure  C-3). 

a.  The  control  file  EVAL5D.CTL  produces  this  output,  which 
contains  histograms  of  the  evaluation  factors  and  the  risk  variable. 

A  table  of  contents  is  given  on  page  2  for  the  user's  convenience. 
Example  histograms  for  the  variables  APDOC  and  RISK  appear  on  pages  3 
and  14. 


b.  At  the  top  of  each  histogram  are  given  summary  statistics  for 
the  data  used  in  the  histogram;  these  statistics  agree  with  those 
produced  in  the  table  on  page  7  of  the-  output  described  in 
section  C.2.1.  Under  the  heading  "INTERVAL  NAME"  are  listed  the 
upper  endpoints  (included)  of  the  intervals  used  in  forming  the 
histogram.  The  histogram  thus  depicts  the  number  of  data  values 
falling  in  each  interval.  For  example,  there  were  six  APDOC  values 
greater  than  3.25  but  less  than  or  equal  to  3.5. 
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C.2.3  Evaluation  Report  83  (See  Figure  C-4). 

a.  EVAL1R.CTL  is  the  control  file  that  creates  this  output  of  the 
risk  regression  analysis  results  for  the  evaluation  data.  A  matrix 
of  the  sample  linear  correlation  coefficients  is  given  on  page  2  for 
each  pair  of  the  variables  used  in  the  regression  analysis. 

b.  The  tables  shown  on  page  3  constitute  the  regression  results 
of  primary  interest  to  the  user.  Note  that  the  dependent,  or 
response,  variable  for  the  regression  is  the  transformed  risk,  LRISK. 
Since  regression  analysis  requires  complete  oases,  that  is,  cases 
having  valid  values  for  all  variables  involved  in  the  regression 
model,  the  set  of  data  cases  used  for  the  regression  analysis  is  a 
subset  of  the  cases  appearing  on  the  EVAL1D.CTL  output  of 
section  C.2.1.  The  coefficient  of  determination,  or  multiple  cor¬ 
relation  coefficient  (R^)  is  labelled  "MULTIPLE  R-SQUARE".  Regres¬ 
sion  coefficients  for  each  of  the  regression  variables  are  listed  in 
the  last  table  on  page  3. 

c.  A  printout  of  the  data  used  in  the  regression  begins  on 
page  5.  The  column  labelled  "PREDICTED  VALUE"  contains  predicted 
LRISK  values  computed  from  the  regression  equation. 

d.  On  page  7  is  a  plot  of  the  predicted  and  observed  LRISK  values 
versus  values  of  the  variable  APRODUCT.  Not  shown  here,  but  included 
in  the  full  output,  are  similar  plots  for  all  the  other  regression 
independent  variables. 

e.  For  normal  probability  plot  of  residuals  on  page  12  is  a 
diagnostic  plot  for  checking  the  distribution  of  residuals  about  the 
regression  model.  Should  the  plotted  data  points  (asterisks)  diverge 
strongly  from  the  diagonal  reference  line  (indicated  by  slashes),  the 
assumption  of  a  normal  distribution  for  the  residuals  would  be  called 
into  question,  and  the  regression  results  would  become  suspect. 
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Figure  C-4.  Evaluation  Report  B3 


THE  BOM  CORPORATION 


8DM/A-85-127Q-TR 


iv 

u 

*♦( 


I 

I 


a 


S 

IS* 


*1 


©  ©  O'  7* 

©  ©  **  r* 

O  «r  r,  H) 

-  ©  ©  d 

t  i 


C  —  —  CM  — 

©  ©  O'*  ch 

©  -  r*  K*  CM 

©  O’  CM  O'  O' 


C  ^  »  31 

C"fl  V  »  N  -fl 

O  O  3  M  N 

2  rt  v  S"3  ii")  iH 


43  in  n  sn  ffl 

X  03  4  O  ^  - 
CM  ©  2  O’  CO  © 
O’  V.  <r  jT  -T  -0 


<r  31  43  n  -  «r  '/J 


CJ  Ui 

©  CD 

CiUlUC  .4. 
C  jJ>«  2*^1 
2  i.  01  x  C  ‘Jl  - 
.xuiui  t-i 

<r  c  c  <r  ©  a:  j 


no  >- 

—  ©  w 

-  Ui 


>  .  CD  3 

2  W 

-  Ui  3  I 

zuuocir 

Ui  2 

-  C  ©  OJ  Ui 
2  .£  -i  w 

m  j  c:  i  i 

i;°  =  = 

:-j  j  j 


—  K>  CM  O'  — 

v  —  >o  fn 

•o  >o  —  o 

o-  -o  ^  43  *»”) 

43  m  N  43  a 

©  ©  ©  ©  o 


^  •*  ©  0*  © 

O  O  N  ^  O 

KV  —  if)  43  © 

©  CM  ©  *0  © 


*3  ®  43  O'  CM 

CM  10  O'  N  O’ 

(M  CM  O'  O'  4) 

N  J  J  ©  e 

111  I 


43  43  —  K*  0* 

N  K)  JD  o  O 

CM  -  -  ©  UI 

©  ©  d  ©  © 

iii  i 


©  in  in  m  43 

th  ©  ©  —  m 

©  o-  o*  ©  CM 

f*  CM  CM  ©  <* 


o  ©  ©  ©  o 


—  O  ©  o*  ^ 

©  *'•<  •:  ri  ^  N 

—  43  —  CM  ~ 

©  O'  in  n  *•  43 

^  CM  —  CM  ©  43 

O'  O  ©  ©  ©  © 

ill  I 


O'  10  4)  N  - 


ui  U  Ui 

2  cl  x  u  3 

ui  O  UI  >  c  2 

-  i  o.  03  j.  : 

2  i,  uj  ui  Ui  Z 

-  <t  c  ©  c  c 


Figure  C-4.  Evaluation  Report  B3  (Continued) 
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C.2.4  Evaluation  Report  B4  (See  Figure  C-5).  This  output  is 
produced  by  the  control  file  MAINT1D.CTL,  whose  function  is  similar 
to  that  of  the  control  file  EVAL10.CTL,  discussed  in  section  C.2.1. 
MAINT1D.CTL  creates  a  SAVE  file  named  MAINT.SAV.  Pages  2  and  3  of 
the  output  are  completely  analogous  to  the  corresponding  portions  of 
the  output  in  section  C.2.1.  However,  the  tables  on  pages  28  and  35 
have  no  analogues  in  the  EVAL10.CTL  output.  They  show  summary 
statistics  for  the  variables  not  only  overall  but  also  for  groups  by 
software  type. 
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C.2.5  Evaluation  Report  B5  (See  Figure  C-6).  This  output  is  created 
by  the  control  file  MAINT50.CTL.  It  is  similar  to  the  output  of 
EVAL5D.CTL,  described  in  section  C.2.2.  Whereas  the  output  of 
EVAL5D.CTL  contains  histograms  for  several  variables,  this  output 
contains  histograms  of  one  variable  (PMPC,  person  months  per  change) 
over  all  software  types  and  for  each  software  type.  Interpretation 
of  the  histograms  is  the  same  for  both  outputs. 
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Figure  C-6.  Evaluation  Report  B5  (Continued) 


Fit  iv  w  an-'  vu  wv  iru  ir\-i  wu  rj  #■  .•  w~  wu  *uwm  vuww/M  w\T&SS+.  ^J\  r^.  r^.  JV"  rV»  V,  A/"  PJ*  rj*  Jf  "j*  rj*  nJ<  r>  rjr^yTJT^, 


THE  BDM  CORPORATION 


BDM/A-85-1270-TR 


—  tn  in  in  *  —  n  o  d  »o  in  <o  ^  ^  ci  a  s*  th  *  ^  a*  ©  ©  ©  ©  z  r*  5 

•"Wlfl<CMD8D0‘lhKMMMMMMMM>^>^ff‘,5vvv:-5j 


Hfl>NONKN|fl^NN-i 


^^»0»^^.rs^CNf>jr<CNC  —  © 

-  (N  - 


-tTOOOOCf  ot  ©  ©  ©  0  ©  © 

~  ©  ©  ©  ©  ©  £  £  6  6  ©  6  6  £  £  £  6 


^CfOCtninCD^1  —  ^lD^C-C*^vrJl0l0!0l0in^'0f^Nrspvpsrvi 
tO0*in(DOMK'Vin:n'fl'ONr''‘rsNSNNNrvNKrs.rvN\Nr*r'*l 

—  —  n  Pi  N  CN  W  Pi  Pi  N  N  MN  (M  N  fJ  N  f*(  N  N  N  N  n  N  M  N  P  i  fi  I 


KHOinMOOK)4)sa'flNf’ 
K*  >0  If]  Pi  CN  (N  — 


^•••OCOOC^O^O-JCO  ©  © 


a 

1 

» 

1  5 

i 

« 

1 

♦ 

1 

*  m 

r- 

1 

1 

!  fN 

1 

n 

i 

1 

♦  O 

N 

1 

1 

1  N 

« 

» 

+  3 

1 

♦  w 

>0 

1  0 

:  «0 

i  a 

1 

1  a 

t 

1  a 

• 

©  Pi  ©  Pi  ©  ©  — 

© 

♦  a 

♦  © 

©  tfj  —  rs  pi  ©  ©  oi 

>0 

1  a 

1  4 

•  0  »  »  n  r»  0  -  2 

1  a 

1 

> . a 

(  a 

1 

Ui  —  «0  V  -T  N  ©  K*  — 

1  a 

! 

S  H- 

« 

*  UJ  O 

+  in 

•  © 

n 

1  a  a 

.  *  in 

»-  > 

1  a  a 

i 

10  X 

|  uj  uj 

1 

Ui 

1  a  a 

1 

cn 

.© 

♦  a  a 

♦  © 

CD 

1  a  a 

1  to 

•oaicoinrssma 

1  a  a 

i 

m  -o  -  -  -a  0  * 

1  a  a 

1 

zno^-vcon- 

1  a  a 

1 

© . 

m 

*  a  a 

«■  m 

ui-(l«r»rrtOrt 

«■ 

1  a  a 

1 

£ 

1  uj  a 

1 

1  uj  Ui 

i 

1  ‘M  Q 

1 

© 

*  in  a 

♦  © 

UJ 

«  ©  u 

'  <r 

0. 

1  ©  u 

1 

■■w 

ta- 

0  u 

f 

h— 

Z  -0  t  il  N  «  O  IMO 

i  ©  u 

1 

Z  -nri  m  -  - 

ti 

♦  UJ  uj 

-  <7 

3 

3  -  z 

r'i 

1  u  u 

l  fO 

in 

U  Ui 

!  0  U  Li 

i 

© 

1  0  U  U 

1 

UJ 

1  0  U  U 

1 

a 

y  2 

© 

+  0  U  U 

5  X 

!  0  U  U 

! 

M 

a  uj 

1  0  U  U 

1 

W 

E©ffiUQ000<E 

1  LJUU3 

1 

UJ 

> 

(  Ui  0  a  0 

1 

tn  0 

jt 

♦  a  u  u  0  0 

*  U“3 

* 

O 

CN 

i  a  u  u  a  0 

I  Pi 

£ 

a 

(  a  u  u  a  a 

1 

£ 

1  ©  u  u  a  a 

1 

X  U 

> 

1  a  u  a  a  a 

1 

u.  0 

in 

© 

♦  ©  u  a  ©  a 

0 

*  Z 

r 

Pi 

1  ©  a  u  ©  0 

a 

1  Pi 

Ui  0 

■  ©  u  u  ©  u 

a 

l 

0  _ 

a  uj  a  a.  e  0.  u 

:  u  u  a  ©  a 

© 

i 

z  s 

^  —  i  3  u  —  Z  © 

1  u  u  a  u  u 

u 

1 

<Z  *N 

<i<CDuioininiu 

tn 

*  u  u  w  u  u 

u 

Z 

-* 

■  u  a  a  u  u 

a 

U  0  0  U  U  U  0 
UUU  JU'JU 


t  0 
)  a  © 

1  ui  u  u  a 

I  0  U  U  Ui 

I  UJ  0  0  UJ 

I  U  U  U  U  Uj 

1  a  u  u  a  a  u 

i  u  u  a  u  <L  u 


©  C'  O  ©  ©  O  '!■  O 


>  ©  ©  V  ©  z  ©  ©  c  ©  ©  Z  ©  ©  ©  V  ©  -Z-  i  c  ©  z  o  o  ©  ©  z-  ©  ©  ©  © 

Z  ©  ©  ©  Z  Z  ©  Z-  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  ©  •©  ©  ©  ©  f- 

00  z-  ©  ©  c  z  ©  ©  ©  c . in 

-  E  . .  .  .  ©  —  Pi  K*  *  if)  O  ^  03  Cr*  ©  —  C  i  r*  *■  in  43  r*  a  >  Z  © 

Z  ©  —  c*  n  <r  i*j  o  mb  ri  n  n  r*  rt  ri  pi  n  fj  ;i  r*  • 


cr 


THE  BOM  CORPORATION 


n  n  o  0*0  w  <  ®  o  o)  -  -  n  w  w  w  : 

n  *•'  -  o  -*  -  in  —  «r  *  *o  a*  x  a  <>  o*  a*  o*  <?*  o  o  >  >  o  c-  c-  c  e  o  r- 

n  «  <  MD  a  CD  o*  o*  >  ^  ^  o*  (h  Kh  •:•  c-  :•  •:  c  •:•  :■ 


s  ■:•  n  c  >o  sm  j*  n  9*  o  ^  o  -c  -o  • 


N  CN  — 


O  C*  C’  0  O  -0  ■ 
.-.  .“.  /*.  .—,  .»  .-“.  . 


—  ^r»^ifNrsoC'C'i(NK*vv«'vv^«'v<ry‘)inninioinin 
«*f^<hMNf*tt«*nniftinjflir>ioin!ntninintfiinininnin:ninifl 

n  -  <o  ♦  a  w  n  w  -o  n  n  o  n  o  o  o  o  c  o  c-  —  ©  o  c-  o  ©  ■;■ 

-  ►*>  r,  -  «  *, 


UJ 

• 

Cl 

! 

>■ 

— 

Z  lH  03 

| 

u 

ifl 

♦ 

3 

c  -  z 

ro 

1 

CJ 

[Si 

J  Li 

1 

CJ 

03 

u 

> 

UJ 

1 

(J 

CJ 

a 

-1  X 

♦ 

jj 

u 

3  X 

r> 

1 

CJ 

CJ 

• 

a  lu 

1 

J 

CJ 

03 

Z  U  X 

1 

CJ 

u 

U i 

> 

1 

CJ 

CJ 

_ 

03  «l 

tH 

♦ 

u 

CJ 

“» 

3 

CN 

1 

CJ 

CJ 

u. 

a 

i 

LJ 

CJ 

3 

z 

1 

J 

J  CJ 

> 

1 

.J 

Cl  X 

03 

■~j 

L 

CJ 

LJ 

r 

n 

i 

u 

■J 

Li  - 

l 

u 

CJ 

u 

CJ 

UJ  CJ 

\ 

CJ 

CJ 

CJ 

4  ^ 

<x 

1 

u 

CJ 

u 

C  N 

w  UJ 

L 

u 

CJ 

LJ 

u 

— • 

J 

Li  CJ 

u 

u 

Jj 

1 

CJ 

CJ  CJ 

u 

u 

•— 

1 

u  u 

CJ  CJ 

u 

LJ 

CJ  CJ 

“  — 

■© 

* 

CJ  u 

U  sJ 

u 

a  i 

1 

Li  U 

u  u 

LJ 

u 

<z 

CJ  u 

u  u 

CJ 

LJ 

u  u  u  u  u  u 

u  u  w  u  j  l; 

UU  J  J  JJ 

U  U  LI  'J  Li  U 

J  'J  J  J  o  u 

J  U  U  'J  'J  u 

u  cj  u  -  u  u 


u 

cj  CJ 

U  —  u 

U  CJ  u 

U  U  w  CJ  L) 

J  J  J  u  u 

UU'JUU 


u 

CJ  u  u 


■:•  o  ©  o  O'  o  o  c  ©  c  c  ©  ©  © 

v  ©  o  c  ©  ©  ©  z  ©  ©  ©  z  o  © 


o  ©  o  z  z 


O  ^  w 

©  ©  5  © 

©  ©  ©  W 


V  W  V  V  ■-•  'V  W  • 


—  Z  . .  ©  —  N  ^  *r  m  43  ^  03  O'  C  —  e  10  -0  ID  O'  ©  <X 

z  c  —  “i  .-■'  'f  n  <3  n  b  n  rt  *i  ri  r:  n  n  ri  fj  Tj  »••  ^ 


B0M/A-85-127Q-TR 


v.v.v.v, 


Figure  C-6.  Evaluation  Report  B5  (Concluded) 
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C.2.6  Evaluation  Report  B6  (See  Figure  C-7).  Created  by  the  control 
file  MAINT7D.CTL,  this  output  is  related  to  that  of  the  file 
MAINT5D.CTL  in  the  preceding  section  in  that  it  provides  histograms 
of  PMPC  by  software  type,  but  in  a  side-by-side  format  (page  2)  on  a 
single  page  instead  of  on  multiple  pages.  Summary  statistics  are 
also  tabulated  for  all  software  types  (groups)  combined  and  for  each 
group  individually. 
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Figure  C-7.  Evaluation  Report  B6  (Concluded) 
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C.2.7  Evaluation  Report  B7  (See  Fioure  C-8).  The  output  of  this 
section,  produced  by  the  control  file  MAINTIR.CTL  is  entirely 
analogous  to  the  output  of  the  control  file  EVALIR.CTL  in 
section  C.2.3.  Note  in  the  tables  of  regression  results  on  page  3  of 
the  output  that  the  dependent  variable  is  the  natural  logarithm  of 
PMPC  -  denoted  "LN(PMPC)". 
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Figure  C-8.  Evaluation  Report  B7  (Continued) 
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Figure  C-8.  Evaluation  Report  B7  (Continued) 
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APPENDIX  D 

STRUCTURE  HIERARCHY  OF  RAMSS  PROGRAMS 

D.l  OVERALL  RAMSS  SYSTEM  HIERARCHY. 

a.  At  its  highest  level,  the  RAMSS  System  is  controlled  by  four 
DOS  batch  files  located  in  the  root  directory  of  the  RAMSS  hard  disk. 
This  "high-level"  hierarchy  is  shown  in  figure  D-I. 


IS  127HK-G  09 


Figure  0-1.  Overall  RAMSS  System  Hierarchy 

b.  Following,  is  a  one-line  abstract  of  the  purpose  of  each  of 
these  batch  routines: 

DB.BAT  Loads  dBASE  III  to  allow  for  dBASE  III  RAMSS  Processing 
EVAL.BAT  Invokes  BMDP  programs  to  analyze  evaluation  data 
MAINT.BAT  Invokes  BMDP  programs  to  analyze  maintenance  release  data 
PRT.BAT  Prints  output  files  resulting  from  EVAL.BAT  and  MAINT.DAT 

0.2  dBASE  III  RAMSS  PROGRAMS  HIERARCHY. 

a.  The  dBASE  III  program  modules  which  control  the  display 
screens,  computation  of  evaluation  scores,  update  of  various  data 
bases,  generation  of  dBASE  III  analysis  reports,  and  the  construction 
of  ASCII  data  files  for  input  into  BMDP  statistical  analysis  programs 
are  presented  in  figure  D-2  in  the  form  of  a  hierarchical  diagram. 
Figure  0-3  presents  a  more  detailed  look  at  the  hierarchical  organi¬ 
zation  of  the  d8ASE  III  modules. 
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Figure  D-3.  d8ASE  III  Logical  Program  Organization 
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dBASE  III  RAMSS  PROGRAM  ABSTRACTS 

Start  Up  Program 
Program  Driver 

Update  System  Information  Data  Menu 
Create  New  System  Information 
Delete  System  Information 
Modify  System  Information 
Update  User/Supporter  Baseline  Estimate  Menu 
Create  New  User/Supporter  Baseline  Estimate 
Delete  User/Supporter  Baseline  Estimate 
Modify  User/Supporter  Baseline  Estimate 
Get  Input  from  User 

Select  Which  Baseline  Block  Profile  Method  will  be 
Used 

Select  Block  Profile  from  Maintenance  Data  Entry 
Select  Block  Profile  from  an  Average  of  Maintenance 
Data 

Select  Block  Profile  from  Previous  Baseline  Estimate 
Replace  New  Values 
Display  Baseline  Estimate 

Calculate  Available  PMPC,  Estimated  PMPC,  and  Esti¬ 
mated  Risk  for  all  Blocks 
Update  Evaluation  Data  Menu 

Select  which  Evaluation  Data  Base  is  to  be  Updated 
RAMSS  Evaluation  Data  Update  (RAEVAL) 

Replace  Lower  Level  Fields 

Replace  High  Level  Fields 

Replace  High  Level  Fields  (continued) 

Experiment  with  "what-if1’  Analysis  (Does  not  Replace 
Values  in  File) 

Experiment  with  "what-if"  Analysis  (Continued) 

Delete  Evaluation  Data  (RAEVAL) 

Software  Life  Cycle  Process  Update  (RASLCP) 
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dBASE  III  RAMSS  PROGRAM  ABSTRACTS  (Continued) 


Input  Software  Life  Cycle  Process  Data 
Update  Files 

Delete  Software  Life  Cycle  Process  Data  (RASLCP) 
Update  Maintenance  Release  Date  Menu 
Create  New  Maintenance  Release  Record 


Delete  Maintenance  Release  Record 


Modify  Maintenance  Release  Record 
Get  Input  Values  From  User 
Replace  New  Values  -  . 

Update  Risk  Regression  Equation  Coefficients  Menu 
Update  Evaluated  Risk  Regression  Equation  Coefficients 
Update  Estimated  Person-Months  per  Change  Coefficients 
Update  AFOTEC  Specific  Parameters 
Generate  RAMSS  Reports  Menu 

Generate  Risk  Assessment  Evaluation  Analysis  Reports 
Menu 

Evaluation  Report  Al:  User/Supporter  Baseline  Esti- 


Evaluation  Report  A2:  Table  of  Evaluation  Scores 
Calculations  for  Evaluation  Report  A2 
Calculations  for  Evaluation  Report  A2  (Continued) 
Evaluation  Report  A3  Major  Factor  Percentile  Chart 
Calculations  for  Evaluation  Report  A3  (For  all 
Systems) 

Calculations  for  Evaluation  Report  A3  (For  Same  Type 
Systems) 

Evaluation  Report  A4  Major  Factor  Risk  Reduction 


Potential 


Calculations  for  Evaluation  Report  A4 

Evaluation  Report  A5  Plot  of  Available  PMPC  Versus 

Estimated  Risk 

Calculations  for  Evaluation  Report  A5 
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dBASE  III  RAMSS  PROGRAM  ABSTRACTS  (Concluded) 

RAGRRPA6  Evaluation  Report  A6  Risk  Assessment  Summary 

RAGRRPO  Generate  Data  Base/File  Reports  Menu 

RAGRRP01  Evaluation  Report  01:  Table  of  Evaluation  Oata 

RAGRRP02  Evaluation  Report  02:  Table  of  Maintenance  Release 

Data 

RAGRRPD3  Evaluation  Report  03:  Table  of  Evaluated  Risk  Regres¬ 

sion  Data 

RAGRRP04  Evaluation  Report  04:  Table  of  Estimated  PMPC  Regres¬ 
sion  Data  -  • 

RAGRRPD5  Evaluation  Report  D5:  Table  of  AFOTEC  Parameters 

RAGRRPB  Build  ASCII  Files  for  BMDP  Reports  Menu 

RAGRRPBE  Build  ASCII  File  of  Evaluation  Data 

RAGRRPBM  Build  ASCII  File  of  Maintenance  Re^ase  Data 

Frequently  called  procedures: 

RALISTEM  List  System  Name  and  Software  System  Name  for  all 

System  IDs 

RALSTRLS  List  all  Release  IDs  for  Selected  System 

RAFACRGR  Factor  Regression  Equation  to  Calculate  Evaluated  Risk 

RAFACRGP  Factor  Regression  Equation  to  Calculate  Estimated  PMPC 

RAESTRSK  Calculate  Estimated  Risk 

RAPLOTIT  Plot  Line  from  Beginning  Value  to  End  Point 

RAPLTCND  Plot  End  Point  of  Value 

RARATEIT  Rate  Risk  as  being  high,  medium,  or  low 
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D.3  BMOP  RAMSS  PROGRAM  HIERARCHY 

a.  The  BMOP  control  files,  which  instruct  3MDP  programs,  are 
invoked  from  the  DOS  batch  files  EVAL.BAT  and  MAINT.BAT.  The  hier¬ 
archy  of  the  BMOP  RAMSS  programs  is  shown  in  figure  D-4: 


aS-1270-TH  G-12 


Figure  0-4.  BMOP  Program  Hierarchy 

b.  The  following  is  a  one-line  abstract  describing  the  purpose  of 
each  of  the  seven  BMOP  control  files: 


EVAL1D.CTL 

EVAL5D.CTL 

EVAL1R.CTL 

MAINT1Q.CTL 

MAINT50.CTL 
MAINT70.CTL 
MAINT1R. CTL 


Reads  ASCII  evaluation  data  file  and  computes  simp’e 
descriptive  statistics 

Produces  histograms  and  plots  of  supportabi 1  i  ty 
factors  and  risk 

Performs  regression  analysis  of  evaluation  data 

Reads  ASCII  maintenance  release  data  file  and 

computes  simple  descriptive  statistics 

Produces  maintenance  profiles 

Plots  maintenance  profiles  for  all  software  types 

Performs  regression  analysis  of  maintenance  release 
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APPENDIX  E 

DATA  BASE/FILE  STRUCTURES 


E.l  INTRODUCTION. 

a.  The  RAMSS  data  base/file  structures  are  described  in  this 
appendix.  The  following  data  bases  are  described: 

b.  RAMSS  data  bases: 


(1)  RASYSI.DBF 

(2)  RAUSBE.DBF 

(3)  RAEVAL. DBF 

(4)  RASLCP. DBF 

(5)  RARLSE  DBF 

c.  RAMSS  memory  files: 

(1)  RAAFTH.MEM 

(2)  RAMFCO.MEM 

(3)  RAPMCO.MEM 


E-l 
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E.2  RASYSI.OBF  -  SYSTEM  INFORMATION  DATA  BASE. 

(1)  Record  length  =  73  bytes 

(2)  Associated  index  files: 

RASYSIID.NOX 
RASYSISS. NDX 

(3)  General  Information: 

This  data  base  contains  basic  information  about  each 
software  system.  Before  any  information  can  be  entered 
into  the  four  other  data  bases  that  make  up  the  RAMSS 
system,  that  system  must  have  an  entry  in  the  RASYSI  data 
base. 

(4)  Special  Notes: 

Each  record  in  the  RASYSI  data  base  has  four  flags  that 
keep  track  of  whether  or  not  the  system  has  associated 
data  in  the  four  other  data  bases.  These  flags  are  set 
to  .F.  when  a  new  record  is  added  to  RASYSI.  As  associ¬ 
ated  data  are  added,  the  flags  are  updated  appropriately. 
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RASYSI 

DATABASE  FIELD  DESCRIPTIONS 


#  FIELD  NAME  FLD  FIELD  DESCRIPTION 
TYP  WIDTH 


1  SWSYSID 

2  CRDATE 

3  SYSTEM 

4  SWSYSTEM 

5  SWTYPE 

6  USER 

7  SUPPORTER 

8  BSLNFLAG 

9  EVALFLAG 

10  SLCSFLAG 

11  MAINFLAG 


3.0  Software  system  id  number 
8.0  Creation  date 

20.0  Name  of  system  in  which  software  is  imbedded 
20 . 0  Name  of  software  system 
3.0  Type  of  software  system  (OFP, C-E , ATD, ATE , etc . ) 
10.0  Using  command 
10.0  Supporting  command 

1.0  Indicates  if  system  has  baseline  info  (T=yes) 

1.0  Indicates  if  system  has  evaluation  info  (T=yes) 
1.0  Indicates  if  sys.  has  S/W  life  cycle  info  (T=yes 
1.0  Indicates  if  system  has  maintenance  info  (T=yes) 


Figure  E-l.  RASYSI. D8F  Variable  Descriptions 
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E.3  RAUSBE.OBF  -  USER/SUPPORTER  BASELINE  ESTIMATE  DATA  BASE 


(1)  Record  length  -  203  bytes 


(2)  Associated  index  files 
RAUS8EID.NDX 


(3)  General  Information: 

This  data  base  contains  the  User/Supporter  Baseline  Esti¬ 
mates  that  suronarize  the  general  resources  and  level  of 
support  activity  required  to  maintain  each  subject  soft¬ 
ware  system. 

This  data  base  has  a  field,  SWSYSID,  also  contained  in 
the  RASYSI  data  base.  This  allows  it  to  be  linked  to  the 
RASYSI  data  base  whenever  necessary. 


(4)  Special  Notes: 

Before  a  record  for  a  software  system  can  be  added  to  the 
RAUSBE  data  base,  there  must  already  be  an  entry  for  that 
system  in  the  RASYSI  data  base. 
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1 

9 

FIELD  NAME 

FLD 

FIELD 

TYP 

WIDTH 

1 

SWSYSID 

N 

3.0 

2 

UPDDATE 

D 

8.0 

3 

RLSDURTN 

N 

5.2 

4 

RLSOVRLP 

N 

5.2 

5 

NSUPP1 

N 

3.0 

6 

PSUPP1 

N 

3.0 

7 

AVGSKILL1 

N 

4.2 

8 

NSUPP2 

N 

3.0 

9 

PSUPP2 

N 

3.0 

10 

AVGSKILL2 

N 

4.2 

11 

NTOTAL1 

N 

4.0 

12 

NT.CORRl 

N 

4.0 

13 

NT  ENH1 

N 

4.0 

14 

NT  CON VI 

N 

4.0 

15 

NC  LOW1 

N 

4.0 

16 

NC  MED1 

N 

4.0 

17 

NC  HIGH1 

N 

4.0 

18 

NP  NORM1 

N 

4.0 

19 

NP  URG1 

N 

4.0 

20 

NP_EMER1 

N 

4.0 

21 

ESTRISK1 

N 

4.2 

22 

PMPCA1 

N 

5.2 

23 

PMPCE1 

N 

5.2 

24 

NT0TAL2 

N 

4.0 

25 

NT  CORR2 

N 

4.0 

26 

NT  ENH2 

N 

4.0 

27 

NT_C0NV2 

N 

4.0 

28 

NC_LOW2 

N 

4.0 

29 

NC  MED2 

N 

4.0 

30 

NC_HIGH2 

N 

4.0 

31 

NP  NORM2 

N 

4.0 

32 

NP_URG2 

N 

4.0 

33 

NP  EMER2 

N 

4.0 

34 

ESTRISK2 

N 

4.2 

35 

PMPCA2 

N 

5.2 

36 

PMPCE2 

N 

5.2 

37 

NT0TAL3 

N 

4.0 

38 

NT_C0RR3 

N 

4.0 

39 

NT  ENH3 

N 

4.0 

40 

NT  C0NV3 

N 

4.0 

41 

NC  LOW 3 

N 

4.0 

42 

NC  MED3 

N 

4.0 

43 

NC_HIGH3 

N 

4.0 

44 

NP  NORM3 

N 

4.0 

45 

NP  URG3 

N 

4.0 

46 

NP  EMER3 

N 

4.0 

47 

ESTRISK3 

N 

4.2 

48 

PMPCA3 

N 

5.2 

49 

PMPCE3 

N 

5.2 

Figure  E 

RAUSBE 

DATABASE  FIELD  DESCRIPTIONS 


S3 


Software  system  id  number 
Update  date 

Release  duration  (in  months) 

Release  overlap  (in  months) 

Number  of  support  personnel  (group  1) 

%  of  support  personnel  ded.to  system  (group  1) 
Average  skill  of  personnel  (group  1) 

Number  of  support  personnel  ( group  2 ) 

%  of  support  personnel  ded.  to  system  (group  2) 
Average  skill  of  personnel  (group  2) 

Total  number  of  changed  *for  block  1 
Number  of  changes  of  type  CORRection  for  block  1 
Number  of  changes  of  type  ENHancement  blockl 
Number  of  changes  of  type  CONVersion  for  block  1 
Number  of  changes  of  complexity  LOW  for  block  1 
Number  of  changes  of  complexity  MEDium  for  block 
Number  of  changes  of  complexity  HIGH  for  block  1 
Number  of  changes  of  priority  NORMal  for  block  1 
Number  of  changes  of  priority  URGent  for  block  1 
Number  of  changes  of  priority  EMERgency  to  block 
Estimated  risk  for  block  1  ) 

Person-months  per  change  (available)  for  block  1 

Person-months  per  change  (estimated)  for  block  1 

Total  number  of  changes  to  block  2 
Number  of  changes  of  type  CORRection  for  block  2 
Number  of  changes  of  type  ENHancement  for  block  2 
Number  of  changes  of  type  CONVersion  to  block  2 
Number  of  changes  of  complexity  LOW  for  block  2 
Number  of  changes  of  complexity  MEDium  for  block  ; 
Number  of  changes  of  complexity  HIGH  for  block  2 
Number  of  changes  of  priority  NORMal  to  block  2 
Number  of  changes  of  priority  URGent  to  block  2 
Number  of  changes  of  priority  EMERgency  to  block  : 
Estimated  risk  for  block  2  ) 

Person-months  per  change  (available) 

Person-months  per  change  (estimated) 

Total  number  of  changes  for  block  3 
Number  of  changes  of  type  CORRection  for  block  3 
Number  of  changes  of  type  ENHancement  for  block  3 
Number  of  changes  of  type  CONVersion  for  block  3 
Number  of  changes  of  complexity  LOW  to  block  3 
Number  of  changes  of  complexity  MEDium  for  block 
Number  of  changes  of  complexity  HIGH  to  block  3 
Number  of  changes  of  priority  NORMal  for  block  3 
Number  of  changes  of  priority  URGent  to  block  3 
Number  of  changes  of  priority  EMERgency  to  block 
Estimated  risk  for  block  3 

Person-months  per  change  (available)  for  block  3 

Person-months  per  change  (estimated)  for  block  3 

-2.  RAUSBE. D8F  Variable  Descriptions 
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£.4  RAEVAL.DBF  -  RAMSS  EVALUATION  DATA  BASE. 

(1)  Record  length:  201  bytes 

(2)  Associated  index  files: 

RAEVALID.NDX 

(3)  General  Information: 

This  data  base  contains  software  supportabi lity  evalua¬ 
tion  scores  for  each  system.  Low  level  evaluation  scores 
in  the  range  1.00-6.00  are  entered-  for  seven  different 
categories.  The  higher  level  scores  are  then  calculated 
from  the  low  level  scores. 

Field  #1,  SWSYSID,  is  also  contained  in  RASYSI  which 
allows  it  to  be  linked  to  RASYSI  whenever  necessary. 

(4)  Special  Notes: 

Before  a  record  for  a  software  system  can  be  added  to 
RAEVAL,  there  must  already  be  an  entry  for  that  system  in 
the  RASYSI  data  base. 
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?ige  No.  1  RAEVAL 

C3/27/86 

DATABASE  FIELD  DESCRIPTIONS 

1 

tf 

FIELD  NAME 

FLD 

TYP 

FIELD 

WIDTH 

DESCRIPTION 

1 

SWSYSID 

N 

3.0 

Software  system  id  number 

VS 

2 

UPDDATE 

D 

8.0 

Update  date 

■ 

3 

USEFLAG 

L 

1.0 

Indicates  if  eval.  data  is  to  be  used  in  analysis 

SG? 

4 

APDOC 

N 

4.2 

Documentation  rating  (avg.  of  fids  5-10) 

5 

APDOCMOD 

N 

4.2 

Modularity  documentation  rating 

£\ 

V 

6 

APDOCDES 

N 

4.2 

Descriptiveness  documentation  rating 

7 

APDOCCON 

N 

4.2 

Consistency  documentation  rating 

8 

APDOCSIM 

N 

4.2 

Simplicity  documentation  rating 

i 

9 

APDOCEXP 

N 

4.2 

Expandability  documentation  rating 

1 

10 

APDOC I NS 

N 

4.2 

Instrumentation  documentation  rating 

11 

APSRC 

N 

4.2 

Source  code  rating  (avg.  of  fids  12-17) 

12 

APSRCMOD 

N 

4.2 

Modularity  source  code  rating 

13 

APSRCDES 

N 

4.2 

Descriptiveness  source  code  rating 

14 

APSRCCON 

N 

4.2 

Consistency  source  code  rating 

15 

APSRCSIM 

N 

4.2 

Simplicity  source  code  rating 

16 

APSRCEXP 

N 

4.2 

Expandability  source  code  rating 

17 

APSRC INS 

N 

4.2 

Instrumentation  source  code  rating 

fc; 

18 

APRODDCT 

N 

4.2 

S/W  product  maintainability  rating (avg.  of  4  &.  11) 

is 

19 

AEPER 

N 

4.2 

S/W  support  personnel  rating  (avg.  of  fids  20-23) 

w 

20 

AEPERMAN 

N 

4.2 

Management  software  support  personnel  rating 

21 

AEPERTEC 

N 

4.2 

Technical  software  support  personnel  rating 

nV  * 

22 

AEPERSUP 

N 

4.2 

Support  software  support  personnel  rating 

23 

AEPERCON 

N 

4.2 

Contract  software  support  personnel  rating 

24 

AESYS 

N 

4.2 

S/W  support  systems  rating  (avg.  of  fids  25-30) 

4 

25 

AESYSHOS 

N 

4.2 

Host  computer  support  systems  rating 

£• 

26 

AESYSBEN 

N 

4.2 

Software  bench  support  systems  rating 

m 

27 

AESYSLAB 

N 

4.2 

Laboratory  integrated  test  support  systems  rating 

m 

28 

AESYSOPE 

N 

4.2 

Operational  support  systems  rating 

29 

AESYSCMS 

N 

4.2 

Configuration  management  support  systems  rating 

30 

AESYSOTH 

N 

4.2 

Other  support  systems  rating 

31 

AEFAC 

N 

4.2 

S/W  support  facility  rating  (avg.  of  fids  32  &  33) 

32 

AEFACOFF 

N 

4.2 

Office  support  facility  rating 

33 

AEFACENV 

N 

4.2 

System  environment  support  facility  rating 

» 

34 

AENVIRON 

N 

4.2 

S/W  support  environment  rating  (avg.  of  19,24.31) 

$• 

35 

AMCON 

N 

4.2 

S/W  configuration  mgt .  rating  (avg.  of  fids  36-39 ' 

:•-: 

36 

AMCONIDE 

N 

4.2 

Identification  configuration  mgt.  rating 

?s 

37 

AMCONSTA 

N 

4.2 

Status  accounting  configuration  mgt.  rating 

38 

AMCONCON 

N 

4.2 

Control  configuration  mgt.  rating  ! 

39 

AMCONAUD 

N 

4.2 

Audit  configuration  mgt.  rating 

i 

40 

AMMAI 

N 

4.2 

S/W  maintenance  mgt.  rating  (avg.  of  fids  41-46) 

rr 

£v 

41 

AMMAIPLA 

N 

4.2 

Planning  of  maintenance  mgt.  rating 

42 

AMMAI ORG 

N 

4.2 

Organization  of  maintenance  rating 

& 

$ 

43 

AMMAIDES 

N 

4.2 

Design  methods  used  in  maintenance  rating 

44 

AMMAI COD 

N 

4.2 

Coding  methods  used  in  maintenance  rating 

w 

45 

AMMAITES 

N 

4.2 

Testing  methods  used  in  maintenance  rating 

» 

46 

AMMAI INT 

N 

4.2 

Organizational  interfaces  for  maintenance  rating 

Sr  '•>' 
$  "•' 

47 

AMANAGE 

N 

4.2 

S/W  life  cycle  support  mgt. rating  (avg. of  35  &  40) 

48 

ASUPPORT 

N 

4.2 

S/W  supportability  rating( avg . of  fids  18,34,  &  47) 

49 

ACONFID 

N 

4.2 

S/W  supportability  confidence  value(eval  estimate) 

S’ 

50 

EVALRISK 

N 

4.2 

Evalulated  risk  computed  from  regression  equation 

E 

51 

VERIFIED 

L  1.0 

Figure  E- 

Inicates  if  record  has  been  verified  (T=yesi 

3.  RAEVAL. DBF  Variable  Descriptions 
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£.5  RASLCP. 08F  -  Software  Life  Cycle  Process  Evaluation  Data  Base. 

(1)  Record  length:  451  bytes 

(2)  Associated  index  files: 

RASLCPID.NDX 

(3)  General  information 

This  data  base  contains  low  level  characteristic  scores 
for  the  software  life  cycle  process  evaluation 
categories.  There  are  a  maximum  of  .40  scores  for  each  of 
the  10  categories. 

Field  #1,  SWSYSID,  is  also  contained  in  RASYSI  and  RAEVAL 
which  allows  it  to  be  linked  to  either  of  these  two  data 
bases  whenever  necessary. 

(4)  Special  notes: 

a)  8efore  a  record  for  a  software  system  can  be  entered 
into  the  RASLCP  data  base,  there  must  already  be  an 
entry  in  the  RASYSI  data  base  ano  the  RAEVAL  data 
base. 

b)  The  40  low  level  scores  for  each  of  the  10  categories 
are  stored  as  40-character  strings.  There  are  two 
reasons  why  the  scores  are  stored  in  this  manner: 

1.  dBASE  III  has  a  restriction  of  123  fields  per 
record.  If  each  score  was  stored  as  a  separate 
field,  the  RASLCP  data  base  would  have  to  be 
divided  into  four  separate  data  bases. 

2.  The  compactness  of  the  file  makes  it  easier  to 

work  with.  When  printing  reports,  the 

40-character  string  can  be  manipulated  easily. 
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*  FIELD  NAME 


1  SWSYSID 

2  UPDDATE 

3  AMCONIDE 

4  SCMID 

5  AMCONCON 

6  SCMCC 

7  AMCONSTA 

8  SCMSA 

9  AMCONAUD 

10  SCMAR 

11  AMMAIPLA 

12  SPMPL 

13  AMMAIORG 

14  SPMOR 

15  AMMAIDES 

16  SPMDE 

17  AMMAICOD 

18  SPMCO 

19  AMMAITES 

20  SPMTE 

21  AMMAIINT 

22  SPMIN 


RASLCP 

DATABASE  FIELD  DESCRIPTIONS 

FLD  FIELD  DESCRIPTION 
TYP  WIDTH 


N  3.0  Software  system  id 

D  8.0  Update  date 

N  4.2  Identification  conf iguration  management  rating 

C  40.0  Individual  identification  scores 

N  4.2  Status  accounting  configuration  mgmt  rating 

C  40.0  Individual  status  accounting  scores 

N  4.2  Control  configuration  management  rating 

C  40.0  Individual  control  scores 

N  4.2  Audit  configuration  management  rating 

C  40.0  Individual  audit  scores 

N  4.2  Planning  of  software  management  rating 

C  40.0  Individual  planning  scores 

N  4.2  Organization  of  software  management  rating 

C  40.0  Individual  orgainization  scores 

N  4.2  Rating  of  design  methods  used  in  S/W  management 

C  40.0  Individual  design  method  scores 

N  4.2  Rating  of  coding  methods  used  in  S/W  management 

C  40.0  Individual  coding  method  scores 

N  4.2  Rating  of  testing  methods  used  in  S/W  management 

C  40.0  Individual  testing  method  scores 

N  4.2  Rating  of  organizational  interfaces  used  in  S/W  r.  r 

C  40.0  Individual  organizational  interface  scores 


Figure  E-4.  RASLCP. DBF  Variable  Descriptions 
E-9 


t.|  •mt 


/.v.v.y.v.v. 


THE  BOM  CORPORATION  BDM/A-85-1270-TR 

£.6  RARLSE  -  .MAINTENANCE  RELEASE  DATA  BASE. 

(1)  Record  length:  163  bytes 

(2)  Associated  index  files: 

RARLSEIO.NDX 

RARLSESR.NOX 

(3)  General  Information: 

This  data  base  contains  history  information  of  actual 
software  releases.  It  can  contain,  one  or  more  records 
for  each  software  system.  Each  record  is  identified  by 
the  combination  of  SWSYSID  and  a  release  identification 
ID  (RLSID). 

J 

Field  #1,  SWSYSID,  is  also  contained  in  the  RASYSI  data 
base  which  allows  it  to  be  linked  to  RASYSI  whenever 
necessary. 

(4)  Special  Notes: 

8efore  a  record  can  be  added  to  the  RARLSE  data  base, 
there  must  already  be  an  entry  for  that  system  in  the 
RASYSI  data  base. 
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03/27/86 

DATABASE  FIELD  DESCRIPTIONS 


ft 

FIELD  NAME 

FLD 

FIELD 

TYP 

WIDTH 

1 

SWSYSID 

N 

3.0 

2 

RLS  ID 

C 

6.0 

3 

UPDDATE 

D 

8.0 

4 

USEFLAG 

L 

1.0 

5 

KLINES 

N 

5.0 

6 

PCHILEV 

N 

3.0 

7 

LANG1 

C 

10.0 

8 

NPERCON 

N 

4.0 

9 

ASKILCON 

N 

4.2 

10 

PDEDSCON 

N 

4.2 

11 

PDEDRCON 

N 

4.2 

12 

NPERORG 

N 

4.0 

13 

ASKILORG 

N 

4.2 

14 

PDEDSORG 

N 

4.2 

15 

PDEDRORG 

N 

4.2 

16 

NPERSONS 

N 

4.0 

17 

AVGSKILL 

N 

4.2 

18 

PDEDSWSYS 

N 

4.2 

19 

PDEDRLS 

N 

4.2 

20 

RLSSTART 

D 

8.0 

21 

RLSEND 

D 

8.0 

22 

RLSFLD 

D 

8.0 

23 

RLSECM 

N 

5.2 

24 

PMEFFORT 

N 

5.1 

25 

PACTUAL 

N 

5.1 

26 

NTOTAL 

N 

4.0 

27 

NT  CORR 

N 

4.0 

28 

NT  ENH 

N 

4.0 

29 

NT  CONV 

N 

4.0 

30 

NC  LOW 

N 

4.0 

31 

NC  MED 

N 

4.0 

32 

NC  HIGH 

N 

4.0 

33 

NP  NORM 

N 

4.0 

34 

NP  URG 

N 

4.0 

35 

NP  EMER 

N 

4.0 

DESCRIPTION 


Software  system  id  number 
Release  identification  number 
Update  date 

Indicates  if  maintenance  info  is  used  in  analysis 
Number  of  K-lines  of  source  code 
Percent  of  source  code  in  high-level  language(s) 
Name  of  primary  language 

#  of  direct  S/W  support  personnel  (contractor) 
Average  skill  level  of*  personnel  (contractor) 

X  of  personnel  dedicated  to  S/W  sys.  (contractor) 

X  of  personnel  time  dedicated  to  release ( contrctr ) 

#  of  direct  S/W  support  personnel  (organic) 

Average  skill  level  of  personnel  (organic) 

%  of  personnel  dedicated  to  S/W  sys.  (organic) 

X  of  personnel  dedicated  to  release  (organic) 

Total  #  of  direct  S/W  support  personnel 

Average  skill  level  of  all  personnel 

X  of  all  personnel  dedicated  to  the  S/W  system 

X  of  all  personnel  time  dedicated  to  the  release 

Release  start  date 

Release  end  date 

Release  fielded  date 

Release  duration,  in  equivalent  calender  months 

Available  person-month  effort  for  engineering  rls 

Actual  person-months  spent  on  release 

Total  number  of  changes  in  release 

Number  of  changes  of  Type  CORRection 

Number  of  changes  of  Type  ENHancement 

Number  of  changes  of  Type  CONVersion 

Number  of  changes  of  Complexity  LOW 

Number  of  changes  of  Complexity  MEDium 

Number  of  changes  of  Complexity  HIGH 

Number  of  changes  of  Priority  NORMal 

Number  of  changes  of  Priority  URGent 

Number  of  changes  of  Priority  EMERgency 


Fiqure  E-5.  RARLSE. DBF  Variable  Descriptions 
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E. 7  RAAFTH.MEM  -  AFOTEC  SPECIFIC  PARAMETERS  MEMORY  FILE. 

RAAFTH.MEM  is  a  dBASE  III  memory  file  which  contains  the 
threshold  and  goal  values  for  evaluation  metric  boundaries  and  risk 
metric  boundaries.  The  following  memory  variables  are  stored  in 
RAAFTH.MEM: 

VARIABLE  NAME  TYPE  DESCRIPTION 

AFTHDATE  D  Date  of  last  update  to  parameters 

AFTH__GE  N  Evaluation  score  goal  (no  greater  than  6) 

AFTH_TE  N  Evaluation  score  -  threshold  (no  less 

than  1) 

AFTHGR  N  Risk  value  goal  (no  less  than  0) 

AFTH  GE  N  Risk  value  threshold  (no  greater  than  1) 
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E.8  RAMFCO.MEM  -  EVALUATED  RISK  REGRESSION  COEFFICIENTS  MEMORY  FILE. 

RAMFCO.MEM  is  a  dBASE  memory  file  which  contains  the  evaluated 
risk  regression  coefficients  and  an  intercept  value  to  be  used  to 
calculate  evaluated  risk.  The  following  memory  variables  are  stored 
in  RAMFCO.MEM: 


VARIABLE  NAME 

MFCOOATE 

MFCOFLAG 


MFC01 

MFC02 

MFCD3 

MFC04 

MFC05 

MFCOCON 


DESCRIPTION 

Date  of  last  update  to  coefficients 

Flag  that  is  .T.  if  the  coefficients  are 

val  id 

Factor  1  coefficient  (AMANAGE) 

Factor  2  coefficient  (APRODUCT) 

Factor  3  coefficient  (AEPER) 

Factor  4  coefficient  (AESYS) 

Factor  5  coefficient  ( AEFAC) 

Intercept  value  (constant  term) 
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E.9  RAPMCO.MEM  -  ESTIMATED  PERSON-MONTHS  PER  CHANGE  REGRESSION 
COEFFICIENTS  MEMORY  FILE. 


RAPMCO.MEM 

is 

a  dBASE  III  memory  file  which  contains 

the 

estimated  person- 

-months  per  change  regression  coefficients  and 

an 

intercept  value  to  be 

used  to  calculate  estimated  person-months 

per 

change.  The  following 

memory  variables  are  stored  in  RAPMCO.MEM: 

VARIABLE  NAME 

TYPE 

DESCRIPTION 

PMCODATE 

D 

Date  of  last  update  to  coefficients 

PMCOFLAG 

L 

Flag  that  is  .T.  if  the  coefficients 

are 

valid 

PMCOl 

N 

Factor  1  coefficient  (AVGSKILL) 

PMC02 

N 

Factor  2  coefficient  (PTCORR) 

PMC03 

N 

Factor  3  coefficient  (PCLOW) 

PMC04 

N 

Factor  4  coefficient  (PCHIGH) 

PMC05 

N 

Factor  5  coefficient  (PPNORM) 

PMCOATD 

N 

Software  type  ATD  coefficient 

PMCOATE 

N 

Software  type  ATE  coefficient 

PMCDCE 

N 

Software  type  C-E  coefficient 

PMCOEW 

N 

Software  type  EW  coefficient 

PMCOOFP 

N 

Software  type  OFP  coefficient 

PMCOCON 

N 

Intercept  value  (constant  term) 

PMCOSD 

N 

Standard  deviation 

E-14 
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APPENDIX  F 
GLOSSARY  OF  TERMS 

F.l  INTRODUCTION. 

a.  The  glossary  of  terms  for  the  RAMSS  has  varied  as  the 
methodology  development  has  progressed.  Refer  to  BDM/A-84-322-TR 
(Final)  dated  September  28,  1984,  for  a  complete  glossary  of  terms 
relating  to  risk  assessment. 

b.  Some  terms  have  more  than  one  description;  when  this  is  the 
case,  the  description  either: 

(1)  Are  significantly  different  between  sources  (though  the 
effective  meaning  may  be  not  much  different) 

(2)  Are  used  differently  (different  users  or  technical 
language) 

(3)  May  be  found  within  the  context  of  a  different  source 

(4)  Have  real  differences  in  meaning. 

Both  DoD  and  non-DoD  (e.g.,  FIPS  PUBs,  NBS  Special  Publications) 
sources  are  used.  The  non-OoD  sources  and  terms  are  not  mandated  for 
our  use,  but  are  rather  included  for  breadth  of  understanding,  for 
those  relevant  terms  commonly  used  with  the  non-DoD  governmental 
and/or  private  sectors. 

c.  The  source  of  each  description  is  indicated  by  a  symbol  in 
parentheses  before  that  source's  term  description: 


V  V  V 
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TERMi 

(SYMBOL!. !) 
Description!.!- 

(SYMBOL 1.2) 
Description!. 2- 


(SYMBOLl.n) 
Description^ , 
TERM2 


TERMN 


The  symbols  used  and  corresponding  sources  are: 


(AF0TECP1)  AFOTECP  800-2,  Volume  I,  10  Nov  82,  "Software  Test 

Manager's  Guide." 

(AF0TECP3)  AFOTECP  800-2,  Volume  III,  1  Jan  84,  "Software  Main¬ 

tainability  Evaluator's  Guide." 

(AF0TECP5)  AF0TEC  800-2,  Volume  V,  25  Jul  83,  "Software  Support 
Facility  Evaluation--User's  Guide." 

(AFR55-43)  Air  Force  Regulation  55-43,  "Management  of  Opera¬ 

tional  Test  and  Evaluation",  28  Jun  1985. 

(AFR800-14)  Air  Force  Regulation  800-14,  Volume  I,  "Management  of 
Computer  Resources  in  Systems,"  12  Sep  75. 

(DoD480A)  OoD  Standard  480A,  "Configuration  Control  -  Engi¬ 

neering  Changes,  Deviations  and  Waivers",  12  Apr  78. 

(ROWE)  Rowe,  William,  An  Anatomy  of  Risk,  John  Wiley,  1977. 

(CURRENT)  Current  document  definition. 
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F.2  GLOSSARY  OF  TERMS  FOR  DEVELOPING  AND  IMPLEMENTING  A  RISK 
ASSESSMENT  METHODOLOGY  FOR  SOFTWARE  SUPPORTABILITY. 

Allocated  Baseline 

(DoD480A) 

See  8aseline. 

Allocated  Configuration  Identification 
(0OD480A) 

Current,  approved  performance  oriented  specifications  governing 
the  development  of  configuration  items  that  are  part  of  a  higher 
level  Cl,  in  which  each  specification  (1)  defines  the  functional 
characteristics  that  are  allocated  from  those  of  the  higher  level 
Cl,  (2)  establishes  the  tests  required  to  demonstrate  achievement 
of  its  allocated  functional  characteristics,  (3)  delineates  neces¬ 
sary  interface  requirements  with  other  associated  configuration 
items,  and  (4)  establishes  design  constraints,  if  any,  such  as 
component  standardization,  use  of  inventory  items,  and  integrated 
logistic  support  requirements. 

Application  Software 

(AF0TECP5) 

The  software  written  by  software  support  personnel,  or  purchased 
from  a  contractor,  used  directly  in  supporting  ECSs.  It  is 
normally  used  for  simulation,  testing,  and  ECS  code  development. 

Automated  Software  Development  Tool 

(AF0TECP5) 

A  component  of  System  Software  that  assists  in  the  design,  imple¬ 
mentation,  documentation,  and  verification  of  ECS  software. 

Availability 

(AFR800-14) 

A  measure  of  the  degree  to  which  an  item  is  in  the  operable  and 
commitable  state  at  the  start  of  the  mission,  when  the  mission  is 
called  for  at  an  unknown  (random)  point  in  time.  (MIL-STD-721) 

(AF0TECP5) 

The  probability  that  a  system  is  operating  satisfactorily  at  any 
point  in  time  when  used  under  stated  conditions. 

Available  Person  Time  (APT) 

(CURRENT) 

The  software  support  person-months  available  for  a  particular 
software  release  computed  as  the  product  of  the  release  duration 
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in  months,  the  number  of  support  personnel,  and  the  percentage  of 
the  time  those  personnel  are  dedicated  to  the  subject  software 

release  (versus  shared  across  other  releases  or  other  software 

systems).  This  time  includes  overhead  activity  directly  related 

to  the  subject  release.  The  release  duration  is  the  release 

engineering  completion  date  minus  the  release  start  date. 


Baseline 


(DOD480A) 

A  configuration  identification  document  or  a  set  of  such  documents 
formally  designated  and  fixed  at  a  specific  time  during  a  Cl's 
life  cycle.  Baselines,  plus  approved  changes  from  those  base¬ 
lines,  constitute  the  current  configuration  identification.  For 


lines,  constitute  the  current  configuration  identification, 
configuration  management  there  are  three  baselines,  as  follows: 


a)  Functional  Baseline.  The  initial  approved  functional  con¬ 
figuration  identification. 


b)  Allocated  Baseline.  The  initial  approved  allocated  con¬ 
figuration  identification. 


c)  Product  Baseline.  The  initial  approved  or  conditionally 
approved  product  configuration  identification. 


(ROWE) 

A  known  reference  used  as  a  guide  for  further  development 
activities . 


Baseline  Profile 


(CURRENT) 

See  Baseline  Software  Change  Profile. 


Baseline  Software  Change  Profile 


(CURRENT) 

The  set  of  numbers  (or  any  subset)  determined  by  specifying  the 
number  of  requests  per  release  for  each  request  category.  A 
request  category  is  the  triple  (type,  priority,  complexity)  where 
type  is  conversion,  enhancement,  or  correction;  priority  is 
emergency,  urgent,  or  normal;  and  complexity  is  high,  medium,  low. 


Baseline  Software  Supportability  Estimate 


(CURRENT) 

See  User/Supporter  Baseline  Estimate 


81ock  Release 


(CURRENT) 

See  Release. 


m 


i 


p 


I 
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(0O0480A) 

See  Conf iguration  Control 
Complexity  of  MA 
(CURRENT) 

See  Maintenance  Complexity 
Computer  Program 
(AFR800-14) 

A  series  of  instructions  or  statements  in  a  form  acceptable  to  an 
electronic  computer,  designed  to  cause  the  computer  to  execute  an 
operation  or  operations.  * 

Computer  Program  Configuration  Item  (CPCI) 

(CURRENT) 

See  Computer  Software  Configuration  Item 
Computer  Resources 
(CURRENT) 

The  totality  of  computer  hardware,  computer  software,  personnel, 
documentation,  supplies,  and  services. 

(AFR800-14) 

The  totality  of  computer  equipment,  computer  programs,  associated 
documentation,  contractual  services,  personnel  and  supplies. 

Computer  Resources  Integrated  Support  Plan  (CRISP) 

(AFR55-33) 

The  CRISP  identifies  organizational  relationships  and  responsi¬ 
bilities  for  the  management  and  technical  support  of  computer 
resources.  It  functions  during  the  full-scale  development  (FSD) 
phase  to  identify  computer  resources  necessary  to  support  computer 
programs  after  program  management  responsibility  and  system  turn¬ 
over  are  transferred.  After  the  transfer,  the  CRISP  continues  to 
function  as  the  basic  agreement  between  the  supporting  and  using 
commands  for  management  and  support  of  computer  resources. 

Computer  Resources  Working  Group  (CRWG) 

(CURRENT) 

A  group  comprised  of  all  the  participating  commands  (for  a 
particular  system)  which  writes  and  updates  the  Computer  Resources 
Integrated  Support  Plan  (CRISP).  The  group  insures  that  necessary 
elements  of  the  CRISP  are  included  in  transfer  and  turnover 

agreements . 


V  >  >  v  V 
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Computer  Software  Configuration  Item  (CSCI) 

(CURRENT) 

See  Configuration  Item 
Conf iguration  Audit 
(CURRENT) 

The  process  of  verifying  that  all  required  conf iguration  items 
have  been  produced,  that  the  current  version  agrees  with  specified 
requirements,  that  the  technical  documentation  completely  and 
accurately  describes  the  conf iguration  items,  and  that  all  change 
requests  have  been  resolved. 

Configuration  Control 

(DOD480A) 

The  systematic  evaluation,  coordination,  approval  or  disapproval, 
and  implementation  of  all  approved  changes  in  the  configuration  of 
a  configuration  item  after  formal  establishment  of  its  configura¬ 
tion  identification. 

Configuration  Identification 

(DOD480A) 

The  current  approved  or  conditionally  approved  technical  docu¬ 
mentation  for  a  configuration  item  as  set  forth  in  specifications, 
drawings  and  associated  lists,  and  documents  referenced  therein. 

Configuration  Index 

(CURRENT) 

This  document,  produced  by  the  development  contractor,  reports  the 
current  status  of  configuration  item  development  in  terms  of 
specifications  and  other  documents  that  depend  on  the  configura¬ 
tion,  such  as  qualification  Test  Plans  and  Procedures,  User 
Manuals,  and  the  Version  Description  Document.  It  lists  all  ECPs 
and  SCNs  incorporated,  approved  ECPs  not  yet  incorporated ,  and 
other  data. 

Conf iguration  Item  (Cl) 


(AFR800-14) 

An  aggregation  of  equipment/software,  or  any  of  its  discrete 
portions,  which  satisfies  an  end  use  function  and  is  designated  by 
the  Government  for  configuration  management.  CIs  may  vary  widely 
in  complexity,  size  and  type,  from  an  aircraft  or  electronic 
system  to  a  test  meter  or  round  of  ammunition.  During  development 
and  initial  production,  CIs  are  only  those  specification  items 
that  are  referenced  directly  in  a  contract  (or  an  equivalent 
in-house  agreement).  During  the  operation  and  maintenance  period. 


s 

t 


THE  BOM  CORPORATION 


BDM/A-35 -1270-TR 


L 


any  repairable  item  designated  for  separate  procurement  is  a 
configuration  item  (APR  65-3). 

Configuration  Management  (CM) 

(DoD480A) 

A  discipline  applying  technical  and  administrative  direction  and 
surveillance  to  (1)  identify  and  document  the  functional  and 
physical  characteristics  of  a  configuration  item,  (2)  control 
changes  to  those  characteristics,  and  (3)  record  and  report  change 
processing  and  implementation  status. 

Configuration  Management  Plan  (CMP) 

(CURRENT) 

A  document  which  describes  project  responsibilities  and  procedures 
for  implementing  CM. 

Conf iguration  Management  System  (CMS) 

(AF0TECP5) 

A  system  applying  technical  and  administrative  direction  and 
surveillance  to  identify  and  document  the  functional  and  physical 
characteristics  of  a  configuration  item;  to  control  changes  to 
those  characteristics  and  to  record  and  report  change  processing 
and  implementation  status. 

Configuration  Status  Accounting 

(DoD430A) 

The  recording  and  reporting  of  the  information  that  is  needed  to 
manage  a  configuration  effectively,  including  a  listing  of  the 
approved  configuration  identification,  the  status  of  proposed 
changes  to  the  configuration,  and  the  implementation  status  of 
approved  changes. 

Consistency 

(CURRENT) 

A  measure  of  the  extent  the  software  products  correlate  and 
contain  uniform  notation,  terminology,  and  symbology. 

Conversion  (Adaptive)  MA 

(CURRENT) 

See  Maintenance  Type. 

Corrective  MA 
(CURRENT) 

See  Maintenance  Type. 
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Critical  Issues 
(AF0TECP1 ) 

Those  aspects  of  a  system's  capability,  either  operational,  tech¬ 
nical,  or  other,  that  must  be  questioned  before  a  system's  overall 
worth  can  be  estimated  and  that  are  of  primary  importance  to  the 
decision  authority  in  reaching  a  decision  to  allow  the  system  to 
advance  into  the  next  acquisition  phase  (OoO  Directive  5000.3). 

Data  Item  Description 

(AFR800-14) 

A  form  which  specifies  an  item  of  data  required  to  be  furnished  by 
a  contractor.  This  form  specifically  defines  the  content,  prepa¬ 
ration  instructions,  format  and  intended  use  of  each  data  product. 

Descriptiveness 

(CURRENT) 

A  measure  of  the  extent  that  software  products  contain  information 
regarding  its  objectives,  assumptions,  inputs,  processing,  out¬ 
puts,  components,  revision  status,  etc. 

Development  Contractor  Activity 

(CURRENT) 

Those  organizations  responsible  for  development  of  a  system  in 
order  to  achieve  an  initial  operational  capability.  Organizations 
include  the  prime  development  contractor  and  any  subcontractors  to 
the  prime  contractor. 

Documentation 

(AF0TECP5) 

All  of  the  written  work  describing  operating  and  maintenance 
procedures  for  a  system. 

Embedded  Computer  Resources 

(AF0TECP1) 

Computer  resources  incorporated  as  integral  parts  of,  dedicated 
to,  required  for  direct  support  of,  or  for  the  upgrading  or  modi¬ 
fication  of  major  or  less  than  major  system(s)  (excludes  ADP 
resources  as  defined  and  administered  under  AFR  30 0  series) 
(USAF/RD/LE  Policy  letter,  13  October  1981). 

Embedded  Computer  System  (ECS) 

(AF0TECP1 ) 

a)  A  computer  that  is  integral  to  an  electromechanical  system  and 
that  has  the  following  key  attributes: 
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(1)  Physically  incorporated  into  a  large  system  whose  primary 
function  is  not  data  processing 

(2)  Integral  to,  or  supportive  of,  a  larger  system  from  a 
design,  procurement,  and  operations  viewpoint 

(3)  Inputs  include  target  data,  environmental  data,  command 
and  control,  etc. 

(4)  Outputs  include  target  information,  flight  information, 
control  signals,  etc. 

b)  In  general,  an  embedded  computer  system  (ECS)  is  developed, 
acquired,  and  operated  under  decentralized  management  (DoD 
Directives  5000.1,  5000.2). 

Emergency  MA 

(CURRENT) 

See  Maintenance  Priority. 

Engineering  Change  Proposal  (ECP) 

(AFR55-43) 

A  formal,  priced  document  (DO  Form  1692)  used  to  propose  changes 
to  the  contact  provisions  and  scope,  if  not  partially  waived  (see 
Contract  Change  Proposal),  and  to  the  configuration  item  baseline 
identification  especially  when  related  equipment,  critical  issues, 
interfaces,  or  technical  manuals  are  affected  or  retrofit  is 
involved.  See  MIL-STDs  480,  481,  and  483;  and  AFR  400-3. 

Enhancement  (Perfective)  MA 

(CURRENT) 

See  Maintenance  Type. 

Estimated  Person  Months  Per  Change 
(CURRENT) 

See  Person  Months  Per  Change 
Estimated  Risk 
(CURRENT) 

See  Software  Supportabi 1 ity  Risk 
Estimation 
(ROWE) 

The  assignment  of  probability  measures  to  a  postulated  future 
event. 
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Evaluated  Person  Months  Per  Change 
(CURRENT) 

See  Person  Months  Per  Change 
Evaluated  Risk 
(CURRENT) 

See  Software  Supportability  Risk. 

Evaluation 

(ROWE) 

Comparison  of  an  activity  performance  with  the  objectives  of  the 
activity  and  assignment  of  a  success  measure  to  that  performance. 

Evaluation  Criteria 

(AF0TECP1 ) 

Standards  by  which  achievement  of  required  operational  effective¬ 
ness/suitability  characteristics  or  resolution  of  technical  or 
operational  issues  may  be  judged.  For  full-scale  development  and 
beyond,  evaluation  criteria  must  include  quantitative  goals  (the 
desired  value)  and  thresholds  (the  value  beyond  which  the  charac¬ 
teristic  is  unsatisfactory)  whenever  possible  (DoD  Directive 
5000.3). 

Expandabi 1 ity 

(CURRENT) 

A  measure  of  the  extent  that  a  physical  change  to  information, 
computational  functions,  data  storage,  or  execution  time  can  be 
easily  accomplished  once  the  nature  of  what  is  to  be  changed  is 
understood. 

(AF0TECP5) 

A  measure  of  the  ease  with  which  the  functional  capability  of 
computer  hardware  or  software  may  be  expanded. 

Facility 

(AF0TECP5) 

The  physical  plant  and  the  services  it  provides;  specific  examples 
are  physical  space,  electrical  power,  physical  and  electromagnetic 
(TEMPEST)  security,  environmental  control,  fire  safety  provisions, 
and  communications  availability. 
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Firmware 

(AF0TECP1) 

a)  Computer  programs  and  data  loaded  in  a  class  of  memory  that 
cannot  be  dynamically  modified  by  the  computer  during 
processing. 

b)  Hardware  that  contains  a  computer  program  and  data  that  cannot 
be  changed  in  its  application  environment. 

Note  1.  Computer  programs  and  data  contained  in  firmware  are 
classified  as  software;  the  circuitry  containing  the  computer 
program  and  data  is  classified  as  hardware  (Data  and  Analysis 
Center  for  Software). 

Functional  Baseline 

(DoD480A) 

See  Baseline. 

Functional  Configuration  Audit  (FCA) 

(Do0480A) 

The  formal  examination  of  functional  characteristics  test  data  for 
a  configuration  item,  prior  to  acceptance,  to  verify  that  the  item 
has  achieved  the  performance  specified  in  its  functional  or 
allocated  configuration  identification. 

Functional  Conf iguration  Identification 

(0oD480A) 

The  current  approved  technical  documentation  for  a  configuration 
item  which  prescribes  (1)  all  necessary  functional  characteris¬ 
tics,  (2)  the  tests  required  to  demonstrate  achievement  of 
specified  functional  characteristics,  (3)  the  necessary  interface 
characteristics  with  associated  Cl's,  (4)  the  Cl's  key  functional 
characteristics  and  its  key  lower  level  Cl's,  if  any,  and 
(5)  design  constraints,  such  as  envelope  dimensions,  component 
standardization,  use  of  inventory  items,  integrated  logistics 
support  policies. 

High  Complexity  MA 

(CURRENT) 

See  Maintenance  Complexity. 

Historical  Maintenance  Profile 
(CURRENT) 

A  histogram  of  data  on  software  system  releases,  with  the  x-axis 
representing  discrete  ranges  of  (available)  person-months  Der 
change  and  the  y-axis  representing  the  number  of  software  system 
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releases  that  fall  into  each  x-axis  discrete  range.  For  purposes 
of  analysis  or  illustration,  the  axes  may  be  reversed. 

Independent  Verification  and  Validation  (IV&V) 

(AF0TECP1) 

An  independent  assessment  process  structured  to  ensure  that 
computer  programs  fulfill  the  requirements  stated  in  system  and 
subsystem  specifications  and  satisfactorily  perform  the  functions 
required  to  meet  the  user's  and  supporter's  requirements.  IV&V 
consists  of  three  essential  elements:  independent,  verification, 
and  validation: 

(1)  Independent.  An  organization/agency  which  is  separate  from 

the  software  development  activity  from  a  contractual  and 
organizational  standpoint.  - 

(2)  Verification.  The  evaluation  to  determine  whether  the 
products  of  each  step  of  the  computer  program  development 
process  fulfill  all  requirements  levied  by  the  previous 
step. 

(3)  Validation.  The  integration,  testing,  and/or  evaluation 
activities  carried  out  at  the  system/subsystem  level  to 
evaluate  the  developed  computer  program  against  the  system 
specifications  and  the  user's  and  supporter's  requirements 
(AFR  88-14). 

Initial  Operational  Capability  (IOC) 

(CURRENT) 

That  point  in  a  system's  life  cycle  when  the  agreed  upon  number  of 
production  systems  has  been  delivered  to  the  user  (using  command) 
for  operational  use. 

Instrumentation 

(CURRENT) 

A  measure  of  the  extent  that  software  products  contain  aids  that 
enhance  testing. 

Interface  Control  Working  Group  (ICWG) 

(MIl-STD-483) 

For  programs  which  encompass  a  system/HWCI/CSCI  design  cycle,  an 
ICWG  normally  is  established  to  control  interface  activity  between 
contractors  or  agencies,  including  resolution  of  interface 
problems  and  documentation  of  interface  agreements. 
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Interoperabi 1 ity 
(AF0TECP5) 

A  measure  of  the  degree  to  which  computer  hardware/software  can 
interface  to  and  operate  with  other  similar  computer  hardware/ 
software. 

Low  Complexity  MA 

(CURRENT) 

See  Maintenance  Complexity. 

Maintainability 

(AF0TECP5) 

The  probability  that  a  system  out  of  service-  for  maintenance  can 
be  properly  repaired  and  returned  to  service  in  a  stated  elapsed 
time. 

Maintenance  Complexity 
(CURRENT) 

The  general  degree  of  difficulty  to  complete  a  maintenance 
request:  high,  medium,  low. 

High:  An  MA  where  changes  are  in  requirements,  design,  code,  and 
test;  or  greater  than  lu  percent  of  CSCI  is  affected;  or  several 
modules  are  affected  by  the  change  (global  changes);  or  the  tech¬ 
nical  nature  of  the  change  requires  highly  specialized  personnel 
skills;  or  the  level  of  effort  by  personnel  is  large. 

Medium:  An  MA  where  changes  are  in  design,  code  and  test;  or 
between  1  percent  and  10  percent  of  CSCI  is  affected;  or  at  least 
two  modules  are  affected  by  the  change  (semi-local);  or  the  level 
of  effort  by  personnel  is  average. 

Low:  An  MA  where  changes  are  isolated  to  only  one  unit  (e.g.,  one 
module/comDi  lation  unit)  of  code;  or  no  more  than  1  percent  of 
CSCI  is  affected;  or  the  level  of  effort  by  personnel  is  minimal. 

Maintenance  Documentation 

(AF0TECP5) 

The  documentation  that  describes  the  maintenance  of  computer 
system  hardware  and  software. 

Maintenance  Priority 

(CURRENT) 

The  criticality  of  the  maintenance  request  in  order  to  preserve 
mission  readiness;  emergency,  urgent,  normal. 
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Emergency;  An  MA  requiring  all  available  personnel's  dedicated 
effort  to  correct  the  problem  as  soon  as  possible  (e.g., 
24  hours);  MIL-STD-1679  severity  code  1  or  2:  mission  termination 
or  severe  degradation. 

Urgent:  An  MA  requiring  next  "block  release"  turnaround; 

MIL-STD-1679  severity  code  3:  mission  impact. 

Normal:  An  MA  not  in  the  Emergency  or  Urgent  categories; 

MIL-STD-1679  severity  code  4  or  5:  mission  inconvenience. 

Maintenance  Profile 

(CURRENT) 

See  Historical  Maintenance  Profile. 

Maintenance  Request  Category 
(CURRENT) 

The  identification  of  a  maintenance  request  by  specification  of 
the  maintenance  priority,  type,  and  complexity. 

Maintenance  Type 

(CURRENT) 

The  type  of  maintenance  actions  required  to  complete  a  maintenance 
request:  conversion,  enhancement,  correction. 

Conversion  (Adaptive)  MA:  Any  change/effort  to  a  software  system 
which  is  initiated  as  a  result  of  changes  in  the  environment 
(e.g.,  hardware,  system  software)  in  which  the  software  system 
must  operate. 

Enhancement  (Perfective)  MA:  Any  change,  insertion,  deletion, 

modification,  or  extension  made  to  a  software  system  to  meet  the 
evolving  needs  of  the  user. 

Corrective  MA:  Any  change  which  is  necessitated  by  actual  faults 
(induced  or  residual)  in  a  software  system. 

Medium  Complexity  MA 

(CURRENT) 

See  Maintenance  Complexity. 

Modularity 

(CURRENT) 

A  measure  of  the  extent  that  a  logical  partitioning  of  software 
products  into  parts,  components,  and/or  modules  has  occurred. 
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(CURRENT) 

See  Maintenance  Priority. 

Operation  Support  Activity 
(CURRENT) 

Those  organizations  responsiole  for  post  deployment  operation  and 
support  of  a  system.  Organizations  include  the  using  command, 
supporting  command,  contractors  (if  used),  and  test  and  evaluation 
agencies  (if  used). 

Operational  Effectiveness 

(AP0TECP1) 

The  overall  degree  of  mission  accomplishment  of  a  system  used  by 
representative  personnel  in  the  context  of  the  organization, 
doctrine,  tactics,  threat  (including  countermeasures  and  nuclear 
threats),  and  environment  in  the  planned  operational  employment  of 
the  system  (DoO  Directive  5000.3). 

Operational  Suitability 

(AF0TECP1) 

The  degree  to  which  a  system  can  be  satisfactorily  placed  in  field 
use,  with  consideration  being  given  to  availability,  compatibil¬ 
ity,  transportability,  interoperabi 1 ity,  reliability,  wartime 
usage  rates,  maintainability,  safety,  human  factors,  manpower 
supportabil ity,  logistic  supportabi 1 ity,  and  training  requirements 
(DoD  Directive  5000.3). 

Person-Months  per  Change  (PMPC) 

(CURRENT) 

Available  PMPC:  Raw  personnel  resources  workload  to  support  a 
user/supporter  baseline  workload  estimate  of  a  specified  number  of 
changes.  Computed  as  the  number  of  full-time  equivalent  personnel 
times  the  release  cycle  in  months  divided  by  the  total  number  of 
changes . 


Estimated  PMPC:  An  estimate  of  a  personnel  resources  workload 
required  to  support  the  user/supporter  baseline  estimate.  This 
estimate  is  computed  by  using  a  regression  equation  whose 
coefficients  are  derived  from  historical  maintenance  release  data. 

Evaluated  PMPC:  A  realistic  estimate  of  personnel  resources  work¬ 
load  effecti veness  to  support  the  user/supporter  baseline  estimate 
as  derived  from  an  evaluation  of  the  software  supportabi 1 ity  char¬ 
acteristics. 
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(CURRENT) 

See  Support  Personnel. 

Personnel  Skill  Level 
(CURRENT) 

A  subjective  integer  rating  from  1  (lowest)  to  5  (highest)  of 
software  support  personnel  experience,  education,  and  specific 
task  responsibility  capabilities. 

Physical  Configuration  Audit  (PCA) 

(DoD480A) 

The  formal  examination  of  the  "as-built"  configuration  of  a  unit 
of  a  Cl  against  its  technical  documentation  in  order  to  establish 
the  Cl's  initial  product  configuration  identification. 

Priority 

(CURRENT) 

See  Maintenance  Priority. 

Probabi 1 i ty 
(ROWE) 

A  numerical  property  attached  to  an  activity  or  event  whereby  the 
likelihood  of  its  future  occurrence  is  expressed  or  clarified. 

Probability  Distribution 

(ROWE) 

The  representation  of  a  repeatable  stochastic  process  by  a 
function  satisfying  the  axioms  of  probability  theory. 

Probability  of  Occurrence 

(ROWE) 

The  probability  that  a  particular  event  will  occur,  or  will  occur 
in  a  given  interval. 

Procurement  Activity 

(CURRENT) 

Those  government  organizations  responsible  for  assuring  delivery 
of  a  production  system.  Organizations  include  the  program  office, 
implementing  command,  development  and  operational  test  and  evalua¬ 
tion  agencies,  and  appropriate  independent  verification  and 
validation  agencies  if  used. 
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Product  Basel ine 

(DOD480A) 

See  Baseline. 

Product  Configuration  Identification 
(DoD480A) 

The  current  approved  or  conditionally  approved  technical  documen¬ 
tation  which  defines  the  configuration  of  a  Cl  during  the 
production,  operation,  maintenance,  and  logistics  support  phases 
of  its  life  cycle,  and  which  prescribes  (1)  all  necessary  physical 
or  form,  fit  and  function  characteristics  of  a  Cl,  (2)  the 
selected  functional  characteristics  designated  for  production 
acceptance  testing,  and  (3)  the  production  acceptance  tests. 

Program  Management  Directive  (PMD) 

(AFR800-14) 

The  official  HQ  USAF  management  directive  used  to  provide 
direction  to  the  implementing  and  participating  commands  and 
satisfy  documentation  requirements .  It  will  be  used  during  the 
entire  acquisition  cycle  to  state  requirements  and  request  studies 
as  well  as  initiate,  approve,  change,  transition,  modify  or  ter¬ 
minate  programs.  The  content  of  the  PMD,  including  the  required 
HQ  USAF  review  and  approval  actions,  is  tailored  to  the  needs  of 
each  individual  program  (AFR  800-2). 

Program  Management  Plan  (PMP) 

(AFR800-14) 

The  document  developed  and  issued  by  the  Program  Manager  which 
shows  the  integrated  time-phased  tasks  and  resources  required  to 
complete  the  task  specified  in  the  PMD.  The  PMP  is  tailored  to 
the  needs  of  each  individual  program  (AFR  800-2). 

Program  Management  Responsibility  Transfer  ( PMRT) 

(AFR800-14) 

That  point  in  time  when  the  designated  Supporting  Command  accepts 
program  management  responsibilities  from  the  Implementing  Command. 
This  includes  logistic  support  and  related  engineering  and  pro¬ 
curement  responsibilities  (AFR  800-4). 

Program  Support  Tools 

(AF0TECP3) 

General  debug  aids,  test/retest  software,  trace  software/hardware 
features,  use  of  compi ler/1 ink  editor,  library  management/con¬ 
figuration  management/text  edi tor/display  software  tools. 
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Program  Test  Plan 
(AF0TECP3) 

Set  of  descriptions  and  procedures  for  how  the  program  is  to  be 
(or  can  be,  or  has  been)  tested. 

Qua! ity  Assurance  (Q A) 

(CURRENT) 

All  actions  that  are  taken  to  assure  that  a  development  organiza¬ 
tion  delivers  products  that  meet  performance  requirements  and 
adhere  to  standards  and  procedures. 

Release 

(CURRENT) 

A  version  of  a  software  system  representing  either  the  initial 
baseline  configuration  or  an  update  to  a  previous  version  that 
incorporates  a  defined  set  of  software  change  requests.  Each 
release  becomes  a  new  baseline  configuration. 

Release  Engineering  Completion  Data 

(CURRENT) 

The  date  when  the  software  engineering  activity  for  a  release  is 
complete.  The  software  engineering  activity  includes  configura¬ 
tion  management,  quality  assurance,  and  software  maintenance 
project  phases  of  requirements,  design,  code,  unit  test,  integra¬ 
tion  test,  and  operational  test.  Activity  including  "kit 
proofing,"  prom  burning,  and  in  general  technical  order  modifica¬ 
tions  which  typically  occur  between  engineering  completion  and 
field  implementation  (distribution)  is  not  included. 

Release  Field  Date 

(CURRENT) 

The  date  when  a  software  system  release  is  officially  distributed 
and  implemented  in  the  field  for  operational  use. 

Release  ID 

(CURRENT) 

A  unique  identifier  for  a  software  system  release. 

Release  Start  Date 
(CURRENT) 

The  date  when  major  analysis  activity  related  to  a  specified 
release  begins  for  which  software  support  resources  are  required. 
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Rel iabil ity 
(ROWE) 

The  probability  that  the  system  will  perform  its  required 
functions  under  given  conditions  for  a  specified  operating  time. 


(ROWE) 

The  potential  for  realization  of  unwanted,  negative  consequences 
of  an  event. 

Risk  Acceptance 

(ROWE) 

Willingness  of  an  individual,  group,  or-  society  to  accept  a 
specific  level  of  risk  to  obtain  some  gain  or  benefit. 

Risk  Acceptance  Function 

(ROWE) 

A  subjective  operator  relating  the  levels  of  probability  of 
occurrence  and  value  of  a  consequence  to  a  level  of  risk 
acceptance. 

Risk  Acceptance  Level 

(ROWE) 

The  acceptable  probability  of  occurrence  of  a  specific  consequence 
value  to  a  given  risk  agent. 

Risk  Acceptance  Utility  Function 

(ROWE) 

The  profile  of  the  acceptability  of  the  probability  of  occurrence 
for  all  consequences  involved  in  a  risk  situation  for  a  specific 
risk  agent. 

Risk  Agent 

(ROWE) 

A  person  or  group  of  persons  who  evaluates  directly  the 
consequences  of  a  risk  to  which  the  person  or  group  of  persons  is 
subjected. 

Risk  Assessment 

(ROWE) 

The  total  process  of  quantifying  a  risk  and  finding  an  acceptable 
level  of  that  risk  for  an  individual,  group,  or  society.  It 
involves  both  risk  determination  and  risk  evaluation. 
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Risk  Assessment  Methodology  for  Software  Supportabi 1 i ty  (RAMSS) 
(CURRENT) 

A  method  of  determining  the  disparity  between  the  estimated  risk 
(determined  from  the  support  concept,  baseline  software  support- 
ability  profile,  and  historical-  maintenance  profile)  and  the 
evaluated  risk  (determined  from  a  conversion  of  the  software 
supportabi 1 ity  evaluation  metrics). 

Risk  Consequence 

(ROWE) 

The  impact  to  a  risk  agent  of  exposure  to  a  risky  event. 

Risk  Determination 
(ROWE) 

The  process  of  identifying  and  estimating  the  magnitude  of  risk. 
Risk  Estimation 
(ROWE) 

The  process  of  quantification  of  the  probabilities  and  consequence 
values  for  an  identified  risk. 

Risk  Evaluation 

(ROWE) 

The  complex  process  of  developing  acceptable  levels  of  risk  to 
individuals  or  society. 

Risk  Profile  Basel ine 

(CURRENT) 

The  measure  of  information  and/or  requirements  which  serve  as  the 
zero  reference  against  which  negative  (and  positive)  outcomes  can 
be  determined. 

Risk  Reduction 

(ROWE) 

The  action  of  lowering  the  probability  of  occurrence  and/or  the 
value  of  a  risk  consequence,  thereby  reducing  the  magnitude  of  the 
risk . 

Sensitivity  Analysis 
(ROWE) 

A  method  used  to  examine  the  operation  of  a  system  by  measuring 
the  deviation  of  its  nominal  behavior  due  to  perturbations  in  the 
performance  of  its  components  from  their  nominal  values. 
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Simp! icity 
(CURRENT) 

A  measure  of  the  extent  that  software  products  reflect  the  use  of 
singularity  concepts  and  fundamental  structures  in  organization, 
language,  and  implementation  techniques. 

Simulation 

(AFR800-14) 

The  representation  of  physical  systems  or  phenomena  by  computers, 
models  or  other  equipment. 

Site 

(CURRENT) 

A  software  support  site,  or  particular  location,  where  software 
support  activity  is  being  accomplished.  Includes  sites  such  as 
the  Air  Logistics  Centers  (ALCs). 

Site  Survey  Form 

(CURRENT) 

The  data  collection  form  used  during  the  software  support  site 
visits  to  collect  background,  evaluation,  and  maintenance  release 
data. 

Software 

( AF0TECP1 ) 

A  set  of  computer  programs,  procedures,  and  associated  documenta¬ 
tion  concerned  with  the  operation  of  a  data  processing  system. 

(CURRENT) 

The  programs  which  execute  in  a  computer.  The  data  input,  output, 
and  controls  upon  which  program  execution  depends  and  the  documen¬ 
tation  which  describes,  in  a  textual  medium,  development  and 
maintenance  of  the  program. 

Software  Change  Request 

(CURRENT) 

An  official  request  that  could  involve  a  change  to  a  software 
system.  Such  requests  include  problem  report,  enhancement 
requirement,  modification  request,  or  any  other  form  that  is 
officially  tracked  by  a  configuration  management  function. 

Software  Configuration  Management 


(CURRENT) 

A  disciDline  applying  technical  and  admini strat i ve  direction  and 
surveillance  to  1)  identify  and  document  the  functional  and 
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physical  characteristics  of  a  configuration  item,  2)  control 
changes  to  those  character  i  sties ,  and  3)  record  and  report  change 
processing  and  implementation  status. 

Software  Del ivery 

(CURRENT) 

That  point  in  the  software  life  cycle  when  the  software  support 
function  assumes  responsioil ity  for  the  "next"  set  of  configura¬ 
tion  changes  to  the  software  (e.g.,  next  block  release).  This 
point  is  logically  no  later  than  PMRT,  but  could  be  as  early  as 
IOC.  This  applies  when  a  contractor  or  government  agency  assumes 
the  software  support  function. 

Software  Error 

(CURRENT) 

The  human  decision  (inadvertent  or  by  design)  which  results  in  the 
inclusion  of  a  fault  in  a  software  product. 

Software  Fault 

(CURRENT) 

The  presence  or  absence  of  that  part  of  a  software  product  which 
can  result  in  software  failure. 

Software  Life  Cycle  Process 

(CURRENT) 

The  policy,  methodology,  procedures,  and  guidelines  applied  in  a 
software  environment  to  the  software  development  and  support  life 
cycle  activities. 

Software  Maintainability 

(AF0TECP1) 

The  ease  with  which  software  can  be  changed  in  order  to: 

(1)  Correct  errors 

(2)  Add/modify  system  capabilities  through  software  changes 

(3)  Delete  features  from  programs 

(4)  Modify  software  to  be  compatible  with  hardware  changes. 
(CURRENT) 

A  quality  of  software  which  reflects  the  effort  required  to  per¬ 
form  software  maintenance  actions. 
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Software  Maintenance 
(CURRENT) 

Those  actions  required  for: 

(1)  Correction  -  Removal,  correction  of  software  faults 

(2)  Enhancement  -  Addition/deletion  of  features  from  the 
software 

(3)  Conversion  -  Modification  of  the  software  because  of 
environment  (data  hardware)  changes. 

Software  Maintenance  Environment 

(CURRENT) 

An  integration  of  personnel  support  systems  and  physical 
facilities  for  the  purpose  of  maintaining  software  products. 

Software  Maintenance  Measures 

(CURRENT) 

Measures  of  software  maintainabi 1 ity  and  environment  capabilities 
to  support  software  maintenance  activity. 

Software  Maintenance  Project  Management 

(CURRENT) 

The  software  life  cycle  process  management  applied  during  the 
support  phase  for  the  software  to  accomplish  specific  software 
maintenance  tasks  which  derive  from  software  problem  reports  or 
change  requests. 

Software  Management 

(CURRENT) 

The  policy,  methodology,  procedures,  and  guidelines  applied  in  a 
software  environment  to  the  software  development/maintenance 
activities.  Also,  those  personnel  with  software  management 
responsibi 1 ities. 

Software  Project  Management 

(CURRENT) 

See  Software  Management. 

Software  Project  Management  Design  Methods 
(CURRENT) 

The  software  project  management  process  utilizes  design  methods 
which  enhance  software  supportability  to  the  extent  that  design 
methodology  standards  and  conventions  are:  1)  documented, 

followed,  and  validated  through  quality  assurance,  2)  can  be 
transitioned  to  support  activity,  and  3)  produce  adequate  design 
specifications  which  reflect  supportability  characteristics. 
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Software  Project  Management  Implementation  Methods 
(CURRENT) 

the  software  project  management  process  utilizes  implementation 
methods  which  enhance  software  supportabi 1 ity  to  the  extent  that 
implementation/coding/testing  methodology,  standards,  and  conven¬ 
tions  are:  1)  documented,  followed,  and  validated  through  quality 
assurance,  2)  can  be  transitioned  to  the  support  activity,  and 
3)  produce  supportable  production  products. 

Software  Project  Management  Organization  Structure 

(CURRENT) 

The  software  project  management  process  organization  structure 
enhances  software  supportabi 1 ity  to  the  extent  that  the  physical 
structure,  functional  responsibilities,  external  interfaces  and 
assigned  personnel  provide  for  continuity  over  the  software  life 
cycle  phases,  and  have  proper  interfaces  with  organizations 
responsible  for  software  support. 

Software  Project  Management  Planning 

(CURRENT) 

The  software  project  management  process  utilizes  planning  which 
enhances  software  supportabi 1 ity  to  the  extent  that  plans  for  the 
development,  test,  product  transfer,  operation  and  support  exist, 
have  been  implemented,  have  been  appropriately  coordinated  across 
activities,  and  satisfy  contractual  and/or  regulation  require¬ 
ments. 

Software  Project  Management  Project  Interfaces 
(CURRENT) 

The  software  project  management  possesses  organization  interfaces 
which  enhance  software  supportabi! i ty  to  the  extent  that  external 
project  organization  relationships  and  responsibilities  are: 
1)  defined,  2)  provide  a  valuable  functional  role,  and 
3)  contribute  to  systematic  cost  effective  procurement,  develop¬ 
ment,  operation  and  support  processes. 

Software  Project  Management  Test  Strategies 

(CURRENT) 

The  software  project  management  process  utilizes  test  strategies 
which  enhance  software  supportabil ity  to  the  extent  that  the  test 
plans,  descriptions,  procedures,  and  results  have  been:  1)  docu¬ 
mented,  2)  can  be  transitioned  to  the  support  activity,  and 
3)  provide  for  a  consistent  and  systematic  process  for  verifying 
and  validating  that  software  requirements  have  been  satisfied. 
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Software  Rel iabil ity 
(CURRENT) 

A  quality  of  software  which  reflects  the  probability  of  failure 
free  operation  of  a  software  component  or  system  in  a  specified 
environment  for  a  specified  item. 

Software  Portability 

(CURRENT) 

A  quality  of  software  which  reflects  the  effort  required  to 
transfer  the  software  from  one  environment  (hardware  and  system 
software)  to  another. 

Software  Support  Concept 

(CURRENT) 

The  estimated  support  personnel  resources,  level  of  dedication  and 
expertise  of  the  support  personnel,  and  the  duration  of  the  block 
release  cycle. 

Software  Support  Facility  (SSF) 

(AF0TECP5) 

The  facility  which  houses  and  provides  services  for  the  support 
systems  and  personnel  required  to  maintain  the  software  for  a 
specific  ECS. 

Software  Support  Personnel 
(CURRENT) 

See  Support  Personnel. 

Software  Support  Resources 
(CURRENT) 

The  totality  of  personnel,  systems,  physical  facilities,  and 
calendar  time  that  are  used/consumed  during  a  software  support 
release  effort. 

Software  Supportabi 1 ity 

(CURRENT) 

A  measure  of  the  adequacy  of  personnel,  resources,  and  procedures 
to  facilitate: 

(1)  Modifying  and  installing  software 

(2)  Establishing  an  operational  software  baseline 

(3)  Meeting  user  requirements. 
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Software  Supportabi 1 ity  Evaluation 
(CURRENT) 

An  evaluation  to  derive  a  measure  of  how  well  a  software  system 
can  be  supported.  (See  Software  Supportabi 1 i ty. ) 

Software  Supportabi 1 ity  Evaluation  Metrics 

(CURRENT) 

The  closed-form  questionnaire  scores  for  each  software  support- 
ability  characteristic  in  a  software  supportabi 1 ity  evaluation  as 
well  as  the  values  computed  by  cumulating  lower  level  scores. 

Software  Supportabi 1 i ty  Magnitude  of  Risk  Consequence 

(CURRENT) 

The  level  of  impact  to  a  software  user  or  supporter  as  a  result  of 
the  risk  level  of  a  software  supportabi 1 ity  negative  outcome. 

Software  Supportabi 1 ity  Negative  Outcome 

(CURRENT) 

Any  outcome  for  which  the  software  support  resources  are  not 
adequate  to  accomplish  required  software  support. 

Software  Supportabi 1 i ty  Risk 

(CURRENT) 

The  probability  at  a  given  point  during  the  software  support  phase 
that  the  software  maintenance  activity  specified  by  a  baseline 
software  supportabi 1 ity  profile  cannot  be  accomplished  with  the 
available  software  support  resources. 

Estimated  Software  Supportabi 1 ity  Risk:  An  estimate  of  the  soft¬ 
ware  supportabi 1 i ty  risk  determined  by  the  area  under  a  normal 
distribution  curve.  The  area  is  the  part  under  the  curve  greater 
than  the  subject  software's  available  person-months  per  change 
value  as  computed  from  the  software  support  concept  and  baseline 
software  change  profile.  The  normal  distribution  curve  is  deter¬ 
mined  by  using  the  estimated  person  months  per  change  as  the  mean 
and  the  standard  deviation  from  the  derivation  of  the  estimated 
person  months  per  change  regression  equation. 

Acceptable  Software  Supportab i 1 ity  Risk:  The  estimated  software 
supportabi 1 ity  risk  which  is  agreed  upon  by  the  user  (using 
command)  and  supporter  (supporting  command)  as  a  result  of  the 
baseline  software  supportabi 1 ity  agreement. 

Evaluated  Software  Supportabi 1 ity  Risk:  An  approximation  to  the 
software  supportabi 1 ity  risk  computed  from  the  software  support- 
ability  evaluation  metrics.  The  computation  is  derived  from  a 
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linear  regression  model  using  the  software  life  cycle  process, 
software  product,  support  personnel,  support  systems,  and  support 
facility  as  the  five  regression  equation  factors. 

Measured  Software  Supportabi 1 ity  Risk:  See  Evaluated  Software 

Supportability  Risk. 

Software  System 

(CURRENT) 

A  set  of  software  (specifications,  programs,  and  data)  which 
constitutes  a  well-defined  major  function  or  group  of  functions. 

Typical  systems  include  avionics  OFP,  ground  based  communications, 
missile  guidance,  simulation,  threat  generator,  ATE,  and  electro¬ 
nic  warfare.  *  . 

Software  System  Type 

(CURRENT) 

One  of  seven  classifications  of  a  software  system's  primary 
functional  mission:  ATD,  ATE,  C-E,  EW,  OFP,  SIM,  SUP. 

ATD:  Aircrew  Training  Device  or  Operational  Flight  Trainer  for 

training  and  support  of  an  operational  system,  usually  in  the  form 
of  a  mockup  simulator. 

ATE:  Automatic  Test  Equipment  software  to  support  the  testing  of 
hardware  units  under  test  (UUT),  create  and  maintain  the  environ¬ 
ment  where  the  test  software  may  be  used,  or  prepare/analyze/main¬ 
tain  test  software. 

C-E:  Communications-Electronics  software  for  command  and  control, 
communications,  surveillance  and  warning,  air  traffic  control, 
intelligence,  and  other  related  functions. 

EW:  Electronic  Warfare  software  that  involves  the  use  of  electro¬ 
magnetic  energy  and  performs  functions  either  separate  or  integral 
to  a  larger  airborne  or  ground  system. 

OFP:  Operational  Flight  Program  software/firmware  that  is 

integral  to  an  onboard  aircraft  computer  system  including  naviga¬ 
tion,  flight  control,  fire  control,  weapon  delivery,  electronic 
engine  control,  and  heads-up  display. 

SIM:  Simulation  Software  not  included  as  part  of  the  ATD, 

including  simulation  models. 

SUP:  Support  Software  including  application  support  software  and 

system  support  software  not  included  in  any  other  category. 
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Specification  Change  Notice  (SCN) 

(CURRENT) 

The  SCN  is  used  to  distribute  approved  page  changes  to  authorized 
users  of  baseline  documents  who,  in  turn,  are  responsible  for 
posting  the  updates. 

Source  Code 

(CURRENT) 

The  form  of  the  program  code  in  its  source  language. 

Standards 


AF0TECP3) 

Procedures,  rules,  and  conventions  used 
disciplined  program  design  and  implementation. 

Support  Concept 


prescribing 


(CURRENT) 

The  software  support  concept  usually  specified  as  part  of  the 
CRISP  and  OS/CMP.  Also  includes  that  part  of  the  support  concept 
necessary  to  establish  the  acceptable  risk  from  a  baseline  soft¬ 
ware  change  profile:  standard  release  duration,  number  of  support 
personnel,  average  skill  level,  percentage  of  personnel  dedicated 
to  releases,  support  facility,  etc. 

Support  Faci 1 ity 

(CURRENT) 

The  physical  facility  resources  that  must  be  available  for  the 
software  support  resources  to  accomplish  a  specific  task(s). 

Support  Personnel 

(CURRENT) 

A  general  term  for  personnel  (military,  DoD  civilian,  or  DoD  con¬ 
tractor)  whose  skills  are  necessary  to  directly  support  mission 
critical  system  software  maintenance.  Includes  but  is  not  limited 
to  management,  technical,  non-technical  support,  and  contractor 
personnel . 

Support  System 

(AF0TECP5) 

Any  automated  system  used  to  change,  test,  or  manage  the  con¬ 
figuration  of  ECS  software  and  associated  documentation.  Includes 
but  is  not  limited  to  Host  Processor,  Software  Bench,  Laboratory- 
Integrated  Test  Facility,  Operational-Integrated  Test  Facility, 
and  Conf igurat ion  Management  System. 


F-28 


T 


THE  BOM  CORPORATION 


3DM/A-35-1270-TR 


Support  System  Facility 
(AF0TECP5) 

The  facility  resources  that  must  be  available  for  the  software 
support  resources  to  accomplish  a  specific  task(s). 

System  Software 

(AF0TECP5) 

All  of  the  software  that  is  part  of  the  software  support  facility 
computer  system.  It  is  never  or  seldom  accessed  directly  by  soft¬ 
ware  support  facility  personnel;  it  controls  the  processing  of 
application  software.  It  includes  the  Operating  System,  Source 
Code  Editor,  Language  Translator,  Link  Editor/Loader,  Librarian/ 
File  Manager,  Data  Base  Manager,  and  Automated  Software  Develop¬ 
ment  Tool .  -  • 

Test  and  Evaluation  Master  Plan  (TEMP) 

( AFR55-43) 

An  overall  Test  and  Evaluation  ( T&E )  plan  designed  to  identify  and 
integrate  the  effort  and  schedules  of  all  T&E  to  be  done  in  an 
acquisition  program. 

Threshold 

(ROWE) 

A  discontinuous  change  of  state  of  a  parameter  as  its  measure 
increases.  One  condition  exists  below  the  discontinuity,  and  a 
different  one  above  it. 

Time  to  Complete  Maintenance  Request  (TC) 

(CURRENT) 

The  calendar  time  from  receipt  of  the  maintenance  request  by  the 
support  control  group  until  the  request  has  been  accepted  as  part 
of  an  operational  system  software  configured  release.  (This  does 
not  mean  the  configuration  is  released  or  distributed,  and  this 
time  does  not  include  this  additional  delay,  if  any.) 


(CURRENT) 

See  Maintenance  Type. 

Uncertainty 

(ROWE) 

The  absence  of  information;  that  which  is  unknown. 
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Urgent  MA 
(CURRENT) 

See  Maintenance  Priority. 

Verification/Validation  (of  computer  programs) 

( AFR800-14) 

The  process  of  determining  that  the  computer  program  was  developed 
in  accordance  with  the  stated  specification  and  satisfactorily 
performs,  in  the  mission  environment,  the  function(s)  for  which  it 
was  designed. 
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